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PROJECT GOALS 

This proiact has the purpose of designing new approaches to training 
personnel in Che development, diffusion, and utilization of instructional 
innovations. The training programs will emphasize preparation to make 
substantial contributions to the development and utilization of individualized 
instruction at preschool, elementary, and secondary levels. 

Gener al Design Criteria . The programs are designed to satisfy a set of 
inter-related criteria as set forth in the list that follows. 

1. All training programs will have the purpose of preparing trainees 
to make impact toward improving instruction in schools. 

2. The programs will place their major emphasis on training for developing, 
diffusing, and utilizing innovations. Training for evaluation and 
research will focus on prepairing trainees to use these skills in 
fostering development, diffusion, and utilization. This relationship 
is represented in the acronjrm DDL/ER. 

3. The contents of training programs, and the contexts within which 
trainees study, will give systematic attention to "critical" problems 
of American education: education of minority groups, stress on 
reading, etc. 

4. The programs are designed on the assumption that no R & D activities 
should be engaged in without taking cognizance of the full set of 
factors involved in an instructional system. These concern designated 
learning goals and means whereby individual students are guided toward 
achieving specified learning objectives. Components of an instructional 
system include curriculum, tests, instructional organization, learning 
materials and equipment, staff, teaching methods, and school/community 
interactions. 

5. In designing the training programs, the same procedures have been 
used that trainees will learn to use in planning and conducting their 
R&D activities. 

6. The programs are not restricted to preparation for today's roles in 
educational R&D; the combination of skills taught a trainee will 
prepare him for new roles as well. 

7. All trainees will receive an introduction to schools, school instruc- 
tional programs, and school /community relationships. 

8. Trainees will be taught to communicate and interact with other R&D 
personnel, both across functions and across levels of specialization 
within functions. 



9. Trainees who perform functions involving working with school people 
will received systematic training for effective communication and 
interaction with them. 
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10. Trainees v?ill be prepared to employ their competencies with a broad 
range of tasks and in a variety of contexts. 

11 • Trainees will receive an introduction to the range of activities 
involved in educational DDU/ER. The areas and depth of this intro- 
duction will vary with the level of training offered. 

12. All trainees will receive training in self-directed problem solving 
and in self evaluation. 

13. An inter-disciplinary emphasis will be provided for through drawing 
trainees from different academic and work backgrounds and through 
providing for the interaction of trainees with persons having different 
backgrounds. Supporting this purpose will be provisions for utilizing 
experts from various disciplines and occupations. 

14. Training programs and program elements will be built so that they can 
be employed in various training contexts. 

15. Through building a consortium representing a broad range of DDU/ER 
activities and settings, provisions will be made for offering training 
involving almost any sort of development, diffusion, or utilization 
activity or context. 

16. In order to ensure that trainees can use their training effectively, 
all programs will stress internship experiences in educational R&D 
agencies. 

17. To ensure that the training needs of individuals having different 
backgrounds and different purposes are met, trainees will be offered 
a variety of programs, long- or short-term, degree or non-degree. 

Logical Framework of the Training Programs, in the design of the training 
programs, a number of theory-oriented reference themes shape objectives and 
training strategies. These are indicated below. 

1. The training programs focus on establishing highly generalizable problem- 
solving competencies. This is particularly important in training for 
responsible roles in educational development, diffusion, and utilization. 
To a lesser extent it is true at the technician or para-professional 
levels where, for example, trouble shooting skills are called for. 

2. The programs are designed explicitly to build the competencies, knowledge, 
and qualities required for designated types of positions. 

3. The programs will establish a conceptual grasp of the positions one is 
being trained for through study of the development/diffusion/utilization/ 
evaluation/research processes and through study of the ways in which 
functions of different DDU/ER positions interrelate. 



The programs will train for transfer through calling upon trainees to 
employ the competencies they acquire in a variety of DDU/ER settings. 

The programs will provide for an intimate linkage of theory and practice. 
This calls for follov;ing the rule that one learns by doing and thinking 
about what he is doing. In the training programs, this aim will be 
fostered especially through the fusion of course work laboratory simula- 
tion, and internships. 

The programs will provide explicit training for participation in group 
problem solving since most work in educational DDU/ER agencies is performed 
by task forces rather than by individuals working singly. The programs 
thus should offer training in group planning, in performing designated 
tasks in group settings, and in evaluation of group products and processes 
Training in communication skills and interpersonal relations is relevant 
here. 

Individualized instruction will be used in conducting the training programs. 
This calls for meeting :he following requirements: 

a. For each roTes, specify training objectives in terms of student 
behaviors 

b. Set performance standards for an acceptable level of mastery of 
objectives. 

c. Placement-test each trainee to determine training objectives he 
has mastered prior to entering the program and those he has yet 
to master. 

d. Diagnose the trainee's characteristics as a learner. 

e. Employing placement-test and diagnostic information, plan 
with the trainee his individual training program. 

f • Pre-test the trainee to determine the extent to which he 
already has achieved the objectives of a unit of training 
he is about to undertake. 

g. Plan with the student the specific "lesson plan" he will 
follow in achieving those training-unit objectives he did 
not satisfy in the pre-test. 

h* Provide the trainee with learning materials, equipment, and 
settings appropriate to his plan for studying the unit of 
work. 

i. Provide the trainee help as needed either on an individual 
tutorial basis or with other trainees, as appropriate. 



J. Continually gather data on the trainee's progress and problems, 
using the data either to confirm or modify his lesson plan. 
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k. Post-test the trainee on the unit of work to determine whether 
he has met performance standards; if not, re-cycle trainee to 
further work on the unit. 

1. Continually revise materials and procedures of the training 
program on the basis of feedback information. 



Products Intended . Five sorts of products are planned for in the design 
of training programs. These products will result from the operational test 
of the programs. 

1. The training programs, when conducted during the operational phase, will 
provide a substantial number of trained educational DDU/ER personnel. 
Program graduates will be persons with specialized training in instruc- 
tional systems design, curriculum development, developing learning 
environments, field testing innovations, designing and conducting local 
change ^ograms, managing innovative projects or programs, and numerous 
other areas of special competence. Degree and certificate programs will 
produce graduates for various professional and technician or para- 
professional roles. 

2. Following the operational phase, tested training programs will be 
available for dissemination to other training agencies or consortia of 
such agencies. The complete programs will include recruitment and 
selection procedures, instructional units, materials and procedures for 
assessing trainees* characteristics and progress in training, guides for 
Conducting instruction in the program, guides for establishing and super- 
vising internships, and procedures for placing program graduates. Also, 
data will be made available to help potential adopters evaluate the 
programs and to aid them in installing them. 

3. A tested model for a consortium of training agencies will be one 
valuable product of the operational phase. Members of the consortium, 
following the design phase, will experience three-and-one-half years 
of intimate cooperation during the operational test. The development 
of effective patterns of communication, decision making, and productive 
work involving all consortium members will be a major oDjective cf the 
operational phase. Formative evaluation procedures will be used contin- 
uously to refine and strengthen the consortium model. By the end of the 
operational test, the consortium model should be sufficiently developed 
and tested that it could be adopted by other groups of agencies. 

4. The operational phase will provide tested approaches to evaluating 
programs to train educational DDU/ER personnel. One basis for assessment 
will be to determine how well a program is designed to match training 
requirements based on job and task analysis. Another will be to assess 
the effectiveness of program implementation. Another basis will be to 
detenr.ine program effectiveness in trrms of trainees' progress. Each 

of these will be employed during the operational test. 
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5. One outcome of the operational test will be contributions to theory and 
research on the selection, training, and utilization of DDU/ER personnel 
in education. The training Drograms are designed on the basis of theory 
and, when available, research findings on training. In designing the 
programs, there are many decision points such as whether to emphasize 
course x^ork, laboratory simulation, or internship experiences in estab- 
lishing a designated competency. Provisions are being built into the 
designs to test such alternatives through varying training approaches 
and using appropriate evaluation procedures. 

PROJECT ACTIVITIES 



Work Plan for the Design Phase . The work of the design phase divided 
into two closely related areas of activity; designing the new training 
programs, and planning an operational test to be conducted by a consortium 
of agencies* 

Designing the training programs began with job and task analyses of 
educational R&D. These analyses resulted in a comprehensive list of R & D 
tasks. Then followed decisions concerning what training programs would be 
conducted and what training stra :egies would be employed. A parallel line 
of activity was a survey of existing training programs and training materials 
for R & D in education. Planning the selected training programs followed. 
It involved specifying learning objectives, outlining course work and lab- 
oratory exercises, identifying internship settings and activities, and 
making provisions for conducting each trainee's program on an individualized 
basis* 

Throughout the design phase, members of the consortium contributed to 
job and task analysis, to the choice of training programs, and to specifying 
sources of trainees and settings for internships. Planning the operational 
test of the training programs has involved the active participation of all 
members of the consortium. 

Design Project Staff * Full-time members of the design staff have been 
Glen Heathers, Project Director; Todd Simonds and Dorothy Zorn, Research 
Assistants; and Susan Tutko followed by Debra Faust, Project Secretary. 
Four members of the staff of the Learning Research and Development Center 
who were major part-time contributors to the project have been John Bolvin, 
William Cooley, Lauren Resnick and John Yeager. Key inputs also have been 
made by the following members of the LRDC staff: C*M. Lindvall, Anthony 
Nitko, and Warren Shepler* Michael Gladis of the Department of Educational 
Psychology of the University of Pittsburgh has contributed to planning course 
work in Instructional Psychology that will be available to students in the 
new training programs. 

Major portions of the work of the design project have been contributed 
by George Cropper of the American Institutes for Research, and by John Folley 
and Kenneth Rifkih of Applied Science Associates under joint agreements 
entered into with their institutions. 
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Job and Task Analyses , Initially, conducting a nation-wide questionnaire 
survey of R & D jobs and tasks was considered. The notion was abandoned as 
not feasible within the time and funds of the design project. Also, such 
a survey would have duplicated much of the work of the survey project being 
conducted concurrently by Teaching Research at Monmouth, Oregon. The anal- 
yses conducted depended on a literature search, consultation with experts 
in educational R&D, and detailed examination of jobs and tasks represented 
within agencies of the project consortium, notably the Learning Research and 
Development Center, Research for Better Schools in Philadelphia, the 
Pennsylvania State Department of Education, the Philadelphia and Pittsburgh 
public school systems, and the office of the Allegheny County, Pennsylvania 
public schools. Task lists prepared by the Teaching Research project and by 
the AERA Task Force on Training Research and Research-Related Personnel also 
were helpful. 

An interview study of tasks performed by research assistants at LRDC 
(conducted by Dorothy Zorn and Todd Simonds) contributed valuable data on 
tasks such personnel perform in the area of development, while a parallel 
investigation of tasks performed by personnel at Research for Better Schools 
contributed to the preparation of the task list for diffusion. Task lists 
provided by representatives of school systems within the project consortium 
were particularly helpful in developing the task list for utilization, that 
is, the design and conduct of local change programs. 

Three chief products have resulted directly from the job and task anal- 
yses. A first is a set of working definitions of development, diffusion, 
utilization, evaluation, and research. These are attached as the concluding 
pages of this section. 

The second product is a comprehensive and systematic List of Tasks in 
Educational R&D that appear as Appendix A of this report. The list is 
divided into eight areas of tasks or competencies: development, diffusion, 
utilization, evaluation, research, R&D foundations, personal/social 
competencies, and project management. 

The third product is A Behavioral Analysis of the Curriculum Development 
Process by George Cropper and Lauren Resnick. It appears as Part A of 
Appendix B. This working paper exempliefies an approach to task analysis 
that provides a specific basis for developing instructional materials for use 
in the training programs. 

Survey of Current Training Programs and Materials . The individualized 
training programs will require an extensive bank of instructional materials 
specifically related to thelist of R & D tasks or to learning objectives 
derived from that list. It will not be feasible, given the limitations of 
time and money for the operational phase, to develop the full range of 
materials needed. Fortunately, this will not be necessary since there is 
a considerable, thotigh diffuse, supply of relevant training materials now 
available or in process of development throughout the country. The bulk 
of materials employed in the training programs to be conducted will be 
drawn from external sources. In many instances, these materials will need 
to be modified to adapt them to the needs of the training programs to be 
conducted in this project. 
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The project staff of the design phase has conducted an extensive search 
for materials currently available or under development. The list of tasks 
defined the scope of materials that were sought; no instructional medium was 
rejected at this stage. The first step in the search was to identify and 
contact persons who had been involved in conducting similar surveys. These 
included persons associated with the AERA Task Force on Training Research and 
Research-Related Personnel; the Special Media Institute of Teaching Research 
at Monmouth, Oregon; the American Institutes for Research; projects under 
U.S.O.E. RFP 70-27; and the ERIC and ENTELEC information systems. These 
sources generaged numerous leads. 

Next, each developer, producer, or distributor identified by the above 
sources was contacted with the request for copies of materials and for 
information about its use and its demonstrated effectiveness. When copies 
of materials were not available, detailed descriptions were sought spec- • 
ifyiing learning objectives, content, method of instruction, estimated modal 
training time, etc. 

As the materials and descriptions came to hand, each unit was analyzed 
for content specifically referenced to the list of tasks, and for type and 
extent of coverage. Information from the analysis was recorded in a cross- 
reference system, with a data sheet for e^ch unit of material and for each 
R&D task. 

Because neither the solicitation nor the analysis is complete, it is 
too early to report specific, substantive findings. Four general observa- 
tions summarize the work to this point: 

1. Considerable materials are available involving tasks in the 
development and evaluation work flows. 

2. A number of promising simulation packages relating to critical 
diffusion/utilization tasks are in the final stages of development. 

3. Few instructional packaged analyzed to this point are independently 
adequate; rather, training units usually have to be built by 
adapting or supplementing materials produced externally. 

4. No materials that have come to hand offer the extensive practice 
opportunities essential to the training programs that are being 
developed in this project. 

Soerifi cation of Training Strategies . Decisions about training strategies 
have been made by training experts within the project consortium, particularly 
staff members of LRDC, the American Institutes for Research, and Applied Science 
Associates. Two key contributions concerning training strategies were 
provided by Lauren Resnick of LRDC and George Cropper of AIR. The Resnick 
contribution was offered in connection with her proposal on teaching trainees 
to prepare instructional materials. She proposed, as types of instructional 
strategies, the use of stimulus fading, diagrams and other visuals as cues 
verbal promoting, simulation, modeling, spacing of practice, both recognition 
and constructed responses, both brief and extended constructed responses, 
backward chaining, different forms of feedback, and role playing. She 
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proposed a four-component instructional program in the preparation of 
lesson materials, as follows: (a) eeminar on the theory of instructional 
or lesson design; (b) seminar on the analysis of instructional materials; 
(c) laboratory in the editing of instructional materials; and (d) labora- 
tory in preparing instructional materials. An internship could run con- 
currently with the above or follow them. 

The Cropper proposal is presented as Part B of Appendix B. In summary, 
the chief points in the strategy he recommends are these: 

1. The same types of stimuli and response.*? thr ♦■ -re involved in actual 
performance of a task should be used ^ ^ ^ctice of the proce- 
dural, problem-solving training taskL 

2. Simulation of non-symbolic stimuli should be used as a way, to avoid 
unsupportable costs. Printed case studies should be used for this. 
Later, trainees should deal with terminal type stimuli. 

3. Programed materials, requiring active practice, would be ideal for 
knowledge components. However, it is unlikely that programed 
materials can be prepared in time for th(. start of training so 
seminars would be usee*. 

4* Paper and pencil exercises can he used to provide the practice 
that can build to terminal performance. Wherever possible, 
practice exercises will relv on demonstration followed by terminal 
perfon^ance. 

5. The curricula of the training programs should exploit a broad 
range of intrinsic and extrinsic reinforcers: stipends, grades, 
degrees; acquisition of professional skills, share in authorship, 
relevance of problems to the trainee's experience, etc. 

6. A core program for each task area should be offered all trainees 
to facilitate communication V7ithin and across functions. 

7. Backward chaining of related training units should be employed when 
possible. Required trainee responses should progress from recogni- 
tion of terminal performance to editing of terminal performance and 
finally to production of such performance. 

Developing a General Model for the Training Programs . The basic 
training model needs co oe consistent wicn tne aesign criteria and with 
the logical framev;ork presented at the beginning of this part of the report 
'mder Project Goals . The model needs tj provide for training that results 
in knowledge and skills that are generalik;able to a variety of R & U con- 
texts; for a broadly-based introduction to educational R & D in terms of 
critical educational problems and in terms of the processes of development, 
diffusion and utilization of innovations offering solutions to those prob- 
lems; for training that takes account of the fact that educational R&D 
is performed mainly by problem-solving teams rather than by individuals 
working singly; and for training to do rathei: than merely to talk or write 
about R&D tasks. Further, the design criteria call for individualized 
training programs and for an emphasis on trainee self-direction. 

ERIC 
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The general model for designing training programs that is being employed 
calls for three types of learning context: course work studied through 
reading, seminars, or media presentations; laboratory exercises or projects; 
and internship experiences. With most R&D tasks in the training programs, 
learning in all three of these types of contexts will be provided. 

The tasks covered in a training program, and the level to which any of 
these is mastered, depends on the area cf specialization and the level of 
training. Areas of specialization for which training will be offered are 
development (curriculum, training programs, or instructional environment), 
diffusion (field testing, demonstration, dissemination), and utilization 
(local change programs). Four levels of training will be provided for: 
Project Director (PD) , Professional Assistant (PA), Technical Assistant (TA) , 
and Para-Professional (PP) . The major differences in the training of Project 
Directors and Professional Assistants will be- in cA-ope (Project Directors will 
receive more training to interrelate developn^ent, diffusion, and utilization) 
and in management training (Professional Assistants will not receive specific 
training to manage operations above a sub-project level). Technical Assistants 
will be trained to perform specific types of highly-structured procedural tasks 
(such as test-item writing) or to apply such technical specialities as film- 
script writing or computer programing to educational R&D. Para-Prof essional 
will be trained uo perform highly specific tasks such as routine data analysis, 
demonstrating equipment, or preparing audiotapes. 

The level of training with respect to a given task follows a formula 
devised by John Folley of Applied Science Associates. His formula (slightly 
modified) follows. 



CORE LEVEL (C) 



Training Emphasis 

Conveying to the trainee: 

a. A description of the task area 

b. Rasic conce^jts and principles 

c. Relation of task area to other task areas 

d. Kinds of ap plications of the task area 



Usual Characteristic of Unit Objective 



erIq 



Recall of inforriation: 

Cl-level: Caa describe the general content of a given task 
area and state types of problems in which the 
axes might be relevant. 

C2-level: Ci\n accurately state a substantial and significant 
body of facts, principles, guidelines in the task 
area, but cannot tnake any significant application 
of the knowledge to solution of real problems. 

Usual Training Approach 

Reading/Seminar/Programed Instruction 
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ANALYSIS LEVEL (A) 

Training Emphasis 

Studies examples of task products, analyzing them in detail with 
reference to variables and interactions of variables specified as 
critical for performance and evaluation of the task. 

Usual Characteristic of Unit Objective 

Demonstrates ability to analyze products as specified. 
Usual Training Approach 

Seminar /Laboratory /Fie Id Observation 

PRACTICE LEVEL (P) 

Pl-leval 

Training Emphasis 

Elementary guided practice. The student works problems in 
a simplified form in order to learn the fundamental skills 
and knowledges and their application to basic problems. The 
problems are simple early in the unit, and become increasingly 
difficult. 

Usual Characteristic of Unit Objective 

Demonstrated abiliuy to perform these simplified problems. 
Usual Training Approach 

Programed Instruction/Laboratory 

P2-level 

Training Emphasis 

Advanced guided practice. The student works problems that present 
a close approximation to the technical complexity he will have to 
face in the rc.::l world. Excltided, however, are the problems of 
interaction with other persons, such as school system personnel, 
the public, etc. 
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Usual Characteristic of Unit Objective 

Can perforin the task such that the work would be completed 
within an economically acceptable expenditure of time, and 
would be judged sound, valid, and correct on all technical 
criteria. This level of competence implies that no review of 
the work would be required by any supervisor, manager, rc.view 
board, etc. The person with this level of competence in a 
task can perform the technical aspects of the task independently. 

Usual Training Approach 

Laboratory problems solved under supervision of a mentor. 

THEORY LEVEL (T) 

Training Emphasis 

Broader application of principles or methods in task area. The 
student learns to apply underlying theory and generalizable 
principles in a variety of situations. 

Usual Characteristic of Unit Objective 

Can properly apply the facts, principles, methods, theory, guide- 
lines, of the task area to the solution of problems such that 
the work would be judged to be sound, valid, and correct. This 
implies independent work not requiring supervision or review. 

Usual Training Approach 

Seminars /Laboratory . 

JOB LEVEL (J) 

Training Emphasis 

Job-like practice. Beginning with simple problems, the student 
learns to attack and solve them in the real environment of DDU/ER. 
He is given problems of increasing difficulty, both in the tech- 
nical sense and in the sense of coping with real-world variables. 

Usual Characteristic of Unit Objective 

Ability to function satisfactorily in the real world of the 
professional DDU/ER person. 

Usual Training Approach 



Internship experiences. 
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In any area of R & D specialization (Developnjent - Curriculum; Diffusion - 
Field Testing; Utilization - Local Change Programs; etc.) training will be 
obtainable for four levels of position: Project Director, Professional 
Assistant, Technical Assistant, or Para-Professional. The differential require- 
ments of different training programs are identified first by specifying those 
tasks to be included in a program, then by specifying for each task the level 
to which it will be masterv^d. The first six training levels (CI through T) 
constitute a general sequence; training in the task can be carried to any 
of these levels. Work at the J level will vary in advancement. Thus a trainee 
for Technical Assistant might advance in a task to the PI level, then perform 
on the job at a level not requiring P2 or T levels of performance. 

In any training program, the tasks the trainee will learn to perform will 
be those required for competence at his level of training and in his area of 
specialization. These tasks will concentrate most heavily within the work flow 
for his area of specialization; however the trainee may need also to learn to 
perform numerous tasks in other task areas. 

Technical Assistants and Para-Professional will be offered short-term 
training programs focused on a limited set of tasks in the area of SDecializa- 
tion. Training in these tasks may be to the PI level, skip the P2 and T levels 
and resume with performance of the task 6r part ot the task m an internship 
or job situation. Short-term training programs will also be offered Project 
Directors or Professional Assistants by selecting a part of the work flow in 
their areas of specialization as the focus of intensive training. 

Trainees in short-term programs will receive a general introduction to 
Educational R&D Foundations, and a core program (at the CI level) introducing 
them to the work flows for Development, Diffusion, Utilization, and Evaluation. 
Also they will receive training in the relevant Personal/Social Competencies. 

In all the training programs, there will be an emphasis on learning in 
group, contexts. Group projects will be included in course work snd labs, ard 
internships will offer experience in team participation. 

Individualization of training will be accomplished by placement testing 
and pretesting each trainee to determine what knowledge and competencies in 
his program he po'jsesses already. Then a special program of studies will be 
planned for him whereby he will gain the knowledge or skills he has yet to 
acquire. When, and not until, a trainee demonstrates mastery of the tasks 
assigned him, he will leave those tasks and proceed to the next tasks in his 
program. Over-all program guidance will be given each trainee by an adviser 
assigned to him for his entire training period. 
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Selecting the r^.^M.. Pro grams to be Con ducted in the Operational Phase. 
Given th lv ^rriiJtations ot'personnel. ti.e. and ^^oney that will apply to 
the operational phase, it will not be possible to desxgn. ^^^J^; -^^^'^"^ ""^^ 
than a few of the numerous training programs that could be offered in the 
areas of Development, Diffusion, and Utilization. Selecting those programs 
to be conducted required judging which among the possible programs would make 
the best use of the resources of the Consortium in making strong, widespread, 
and early impact on instruction in critical problem areas. 

The decision has been made to develop and conduct "^j^f^S f ^S";"^ ^" 
two areas of specialization: Development - Curriculum, and Utilization- 
Local Change Programs. There were several reasons for making this decision. 
ihechoJ^e of curriculum development as one program area was made because 
the fost fundamental approach to the solution of critical ^^""^ P"^/'"^ 
is to build rarricula whose learning objectives and instructional materials 
are specif ically designed to deal with those critical problems and to reach 
the appropriate student populations. 

Competencies in curriculum development are strongly represented among 
members of the Consortium. The Learning Research and J^?""^"^ .^^^If , 
conducts several major programs of curriculum development for 
instruction at preschool and elementary levels for various student populations 
including children from the inner city. Research for Better Schools does 
extensiJI work in curriculum development. The American Institutes for Research 
and Applierscience Associates both have expertise in curriculum development, 
particularly for training programs. Other members o the Consortium also 
engage in curriculum development or in adapting curricula for use in schools. 

A point requiring emphasis is that the process of curriculum development 
necessarily involves Lsks from several R & D areas. Implementing a curriculum- 
a necessary part of its development-calls for modifying the instructional 
^n'ronmen't and for training teachers to use the curriculum. Test development 
skills are required in building the achievement sub-tests accompanying 
ll'^llZl lTi.s. Skills in formative and summative ^^^^^^^^ 
in building the curriculum and in assessing its outcomes. Research skilly are 
needed at those points where it is necessary to conduct studies P^viding 
bases for designing the curriculum. Project management skills are needed xn 
positions involving supervision of co-workers. 

The decision to conduct programs in the area ot Utiliz- ■ .^ - ^o^al Change 
Programs was made to give emphasis to the pay-off of educr ^ ; / 
the implementation of innovations in the instructional progr^.,-. of the schools. 
The ultimate consumer of innovations is the student. Local change programs 
provida the instrumentality whereby innovations reach the student. 

Most of the agencies in the Consortium are involved in the design, conduct, 
and evaluation of Leal change programs. Most '^^'^"tly involved are the four 
public school systems in the Consortium: Avonworth, Baldwin-Whitehall, Phila 
delphia. and Pittsburgh. The Pennsylvania State Department o ^duca ion and 
the Allegheny County Public Schools play major roles in relation to local change 
nrLrins especially programs under Titles I and III. WQED-TV works extensively 
Ti h Sc;i s hoof sys'te:' in change programs involving i-«uctional television. 
Both LRDC and RBS have many associations with school systems in relation to 
change programs involving individualized instruction. 
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Training programs in the area of Utilization require learning to perforin 
many tasks in other R&D areas* The analysis of local needs and resources 
requires competencies in formative evaluation as does the design and conduct 
of change programs. Designing change programs involving curriculum modifica- 
tions requires competencies in the analysis of curricula • Designing ways to 
implement curricula calls for competencies in staff training and in modifying 
the instructional environment. When a change program is implemented, most of 
the skills involved in Diffusion - Field Testing are needed. And, when it is 
decided to spread a local change program that has been implemented and tested 
in pilot schools to other schools in the system, skills in Demonstration and 
Dissemination are needed. 

The decision has been made to offer training during the first year of 
the operational test only for Project Directors and Professional Assistants, 
leaving for later the conduct of training programs for Technical Assistants 
and Para-Professionals. The decision to employ training resources at the 
two upper levels of training reflects the judgment that the most critical 
training needs are at these -levels. Also, surveys made of R & D agencies 
in education have revealed few positions at the level of technician or para- 
professional. (Doubtless training programs at the lower levels are needed 
and should result in more efficient use of the competencies of higher-level 
personnel through relieving them of the need to perform tasks that less 
well-trained personnel can perform. Such programs will receive attention 
during the latter part of the operational phase.) 

Another key decision made is to offer both long-term and short-term 
training programs in each of the two areas of specialization. Short-term 
programs will be offered beginning in the summer of 1971 and continuing 
on-the-job during the fall months. Long-term programs will be initiated in 
September 1971, will be two or three years in length, and will offer the 
masters or doctoral degree or equivalent certification. The advantage of 
the short-term programs is that they offer prompt pay-off in key aspects 
of development or utilization. The advantage of the long-term programs is 
that they will provide a high level of training suitable for major contri- 
butors to educational R&D. 

The short-term program in Development will train for building instruc- 
tional materials. This ic a key aspect of curriculum development. Also, 
it is separable from other aspects and can be taught in a relatively short 
period of time to a level of effective productivity. In this program, 
trainees will be taught to build curriculum materials, given a set of 
objectives for the unit or lesson to be built. The program will build 
and test units that s^an be valuable for training the thousands of research 
assistants engaged in the writing of learning materials in the many curriculum 
development agencies across the country. Obviously, a short-term program 
offering a total of six to eight weeks of training cannot do the full job 
of preparing leadership in the design and conduct of local change programs. 
This is the task of the long-term program being offered. What is claimed 
for the short-term program is that it can substantially upgrade the quality 
of plans for local innovative programs, increasing their relevance to critical 
educational problems and improving the probability that they will be effec- 
tive in dealing with such problems. 

ERIC 
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Designing the Training Programs to be Initiated During 1971-72 , Building 
components of the four training programs is the chief task of the first six 
months of the operational phase. A function of the design phase is to indicate 
which components must be built and what requirements they must satisfy. The 
program designs are presented in Part IIA of this report. The designs employ 
the training strategies and the general model for training programs presented 
earlier in this section of the report. 

'P\e first step in outlining each of the four training programs was that 
of specifying the tasks in the List of Tasks in Educational R&D (Appendix A) 
that will provide the content of the program. Next, the level at which each 
of these tasks will be mastered was set. With Programs 2 and 4, the levels 
were set differently for Project Directors and for Professional Assistants. 
Obviously, both of these sorts of decisions had to be made without a specific 
data base; expert judgment had to be depended upon in the absence of any other 
criteria. Many of the judgments made doubtless will prove erroneous when the 
training programs are developed and tested. 

The third design step was to spell out the training approaches that will 
be employed in the programs. Illustrations of approaches to be used can be 
found in Appendix C. The first illustration offered there (by Heathers) 
exhibits how training units can be identified by analyzing the requirements 
(or aspects) of a task, then matching these requirements with suitable training 
content. The four tasks in the illustration vere drawn from the work flow for 
curriculum development. The second illustration (by Resnick) specifies a 
training strategy and applies it to a key task in the work flow for curriculum 
development— prepare instructional materials. The third illustration (by 
Cropper) presents training materials on identifying and analyzing terminal 
objectives of instructional programs. This illustration, developed in snother 
project, employs the method of task analysis and the instructional strategy 
presented in Appendix B of this report. 

With each training piogram, designating the training approach called for 
indicating how course work, laboratory units, and internship experiences 
would be utilized to cstf>blish the knowledge and skills required by the 
program. While course work and labs, generally speaking, will precede the 
internship in order to provide a foundation of knowledge and skills, real- 
work experiences will be made to interact with study and labs whenever 
feasible. Thus seminars and labs will continue during the internship period 
to supplement, strengthen, and integrate the trait. in,; received in the internship. 
Once again, decisions made concerning instructional approaches had to be based 
on the judgment of consortium members having expertise -fn instructional systems 
design, curriculum development, training program dt>/elovment , and uses of 
instructional media. 

Closely related to the training approach is the design of procedures for 
individualizing the instruction each trainee will receive. The general 
approach used can be labeled instructional guidance* It begins with trainee 
recruitment and continues with selection, orientation, individualized program 
planning, supervision and counseling, progress assessment, certification of 
training accomplis>imentP, job placement , and follow-up. The heart of the process 
is continuing contract-type planning by the trainee and his adviser on the 
basis of regular and systematic learner diagnosis and achievement assessment. 
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An aspect of program design that has been given little attention thus 
far is that of estimating training time. One reason for this is that indiv- 
idualized instruction allows that different trainees take very different amounts 
of time to master a given task. Another reason is that estimating training 
time can be done much better after training materials and procedures are 
fairly well developed than before. To a considerable extent, the duration of 
a trainee^s program will be determined by factors other than his entering 
behaviors and his learning rate. Course work usually has to be set within 
a fairly rigid time frame, especially if university credit is offered. 
Students cannot always be made free to advance at whatever rate they can 
master course requirements. Likewise, internships usually require that the 
trainee remain in the same job for several months in order that his produc- 
tive output justifies the time and money spent on hin. In designing the 
programs, special efforts have been made to provide 'lexibility in program 
elements, training experiences, and time allocation :n older to enhance the 
individualization of instruction. 

Activities of the Project Consortium Durinp, the O esi^n Phase . Throughout 
the design phase, major attention has been paid to the devt:lopment of a 
cons rtium of agencies for work on the design of training programs and for 
conducting the operational test of the programs. Fifteen agencies were mem- 
bers of the Consortium at the close of the design phase. A list of these 
agencies, and their representatives on the Consortium, is included in Part 
IIB of this report. Types of agencies in the Consortium are these: 



Research and Development Centers 
Regional Educational Laboratories 
Universities 

State Education Departments 
Intermediate Educational Units 
Large School Districts 
Small School Districts 

Private (Profit and Non-Profit) Educational R&D Agencies 
The Education Industry 
Educational Television 

Each of the 15 member agencies has made specific inputs to the design phase. 
EAch month during the design phase, a half-day meeting has been held of the full 
Consortium for the purpose of reviewing progress and planning next steps. Seven 
such meetings were held. Planning with different members of the consortium, 
singly or in task forces, has been a continual process throughout the entire 
design phase. All members of the consortium have provided valuable information 
on R & D jobs and tasks. Most have contributed to the identification of training 
approaches and materials. 

Near the end of the design phase, all members of the consortium responded 
to a questionnaire asking for specific ways in which they would be prepared to 
participate during the operational test of the training programs. The results 
of this inquiry are presented in Part IIB of this report. 

The Consortium has been formally organized for the operational phase in 
terms of a Working Agreement signed by all parties. One proof of the viability 

ERIC 



- 17 - 



of the Consortium is that all 15 agencies signed the agreement and indicated 
the desire to participate in the operational ohase. 

Developing a Plan for Locating and Bur>ding Training Materials . A major 
task during the operational phase will be the continued search for usable 
training materials developed elsewhere. The search for such materials made 
during the design phase has been referred to earlier (pages 6-7, above). 
Search, analysis, and reference procedures developed in that quest will be 
employed during the operational phase. The process of building training 
units will be facilitated by the cross-reference system developed to record 
information. For each R&D task or task area, a single reference sheet 
indicates the extent and kind of coverage provided by the training materials 
that have been located. Adequate coverage demands theory and procedural 
presentations, and extensive practice opportunities. These three seldom 
are found in one unit of training material. The reference chart indicates 
which training units to select and collate (with adaptive editing) to provide 
for the needed coverage. During this process, the gaps in available materials 
will become evident, pointing to further survey or development needs. 

Since the survey probably will locate few materials offering extensive 
laboratory practice opportunities, a complementary search will be conducted 
to develop a bank of case materials for use in labs, '^his bank should include 
such items as lesson specifications generated in curri^^ulum projects, 
curricular materials with real tryrout data, and case data on act lal diffusion 
or local change programs. An excellent source for this kind of )w material 
is the training consortium itself. The case and project material that members 
of the consortium can provide will constitute, when structured for use in labs, 
a set of practice materials as realistic and representative as can be found. 

A third search will be conducted to locate theoretical and descriptive 
materials for use in seminars that will be offered in the training programs. 
These materials should represent the major issues, theoretical positions, and 
innovative activities involved in current efforts toward improving instruction. 
The compendium of documents on educational R&D being compiled by Teaching 
Research will be especially valuable in this connection. 

The work of building training materials to be conducted by or arranged 
by the project Compendium and staff will be performed in several ways. One 
approach will be to sub-contract segments of the materials develjpment task 
to the American Institutes for Research, Applied Science Associates, or other 
agencies within and outside the Consortium having expertise in building 
training materials. It is planned that a major part of the training materials 
for the core level will be developed through such sub-contracts. As part of 
their training, trainees in the programs will be called upon to locate or 
generate training materials and to contribute them to the materials bank. 
Finally, throughout the operational phase, the project staff will devote a 
major share of its work to materials development since many needs of the 
training programs cannot be met in any other way. 

In the Scope of Work, specifications on how materials development 
activities will be conducted during the operational phase are presented. 
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Planning to Develop, Implement, and Assess the Training^ Programs , The 
process of developing the training programs to the point where they can be 
implemented and assessed has been a major focus of planning activities during 
the design phase. Linked with this process has been that of planning the 
instrumentalities for placing the programs in operation, modifying them 
through formative evaluation, and assessing their outcomes. 

While the general specifications for the four training programs have 
been formulated during the design phase, much work needs yet to be done 
before the programs will be operable. In addition to developing training 
materials, details must be worked out on procedures for conducting the 
programs, on instructional settings and schedules, on personnel to conduct 
instruction in the programs, and on administrative aspects of the operational 
phase. These planning and development activities are included in Scope of 
Work under program development activities. 

In preparing to implement the training programs, two areas of activity 
during the design phase have been central. One has been the detailed planning 
for the participation of Consortium members during the operational phase. The 
outcomes of this planning are presented in Part IIB. 

The other key area of planning has been building, within the School of 
Education at the University of Pittsburgh, a new program in Instructional 
Development that will provide the coordinating agency for the training programs, 
a chief locus of training, and the medium for offering trainees credits, degrees, 
and certification. The program will provide a comprehensive and system- 
atically interrelated set of training components covering the variety of 
tasks involved in the List of Tasks in Educational R&D (Appendix A) . The 
p-ogram will be established as inter-departmeniial , with instructors drawn 
from Educational and Developmental Psychology, r!ducational Research, Psychology, 
Educational Communications, and other university departments. Most of the 
instructors also will be members of the staff of LRDC. The program will be 
directed, during the operational phase, by a faculty member of the School 
of Education who also will be a member of the staff of LRDC and the director 
of the operational test project. 

The work in Instructional Development will be supplemented by course- 
work offered in various departments of the University of Pittsburgh. This 
refers especially to courses in psycholoj>y, educational and developmental 
psychology, educational research and evaluation, educational coimiunications , 
educational administration, and computer sciences. Of particular interest 
is the establishment, within the Educational and Developmental Psychology 
Department, of a new doctoral program in Instrtictional Psychology. This 
program will provide course work that is highly relevant to the needs of 
trainees in Instructional Development for psychological theory and research 
related to instruction. 

A general plan for formative and summative evaluation of the training 
programs has been outlined by CM. Lindvall of the LRDC staff. Developing 
this plan in detail, and providing for its implementation, is part of the 
program development work to be performed during the initial months of the 
operational phase. 
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A plan for administering the operational phase, and a general work 
plan for the three-and-one-half-year project, have been prepared with the 
assistance of John Yeager and Todd Simonds. The full-time project staff, 
to be located at LRDC and the School of Education, University of Pittsburgh, 
will consist of the project di.rector, two senior research associates, two 
research assistants, and a secretary. In addition, numerous members of the 
LRDC staff will contribute portions of their time to program development, 
program assessment, and instruction within the programs. Further, numerous 
faculty members of the University of Pittsburgh will instruct within the 
programs. Details concerning project personnel, including Consortium mem- 
ber's contributions to instruction in the programs, will be worked out as 
part of the program development activities. 

A general work schedule for the 42 months of the operational phase is 
presented in the Introduction to Scope of Work . This schedule is tentative; 
major revisions may be needed as program development proceeds during the 
early months of the operational phase, or as experience is gained in imple- 
menting and assessing the training programs. Highlights of the work schedule 
are the focus on program development, materials development, and trainee 
recruitment between February and June of 1971; on training activities accom- 
panied by further materials development work during tbi» period July 1971- 
June 1972; on development activities related to two additional training 
programs— Development: Training Programs, and Development: Instructional 
Environment Systems—during the first six mont.is of 1972; and on the 
launching of these two additional programs during the fall of 1972. 
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DEFINITIONS OF DEVELOPMENT, DIFFUSION, UTILIZATION, 
EVALUATION, AND RESEARCH (DDU/ER) 



DEVELOPMENT refers to any or all parts of the process of engineering a product 
from the inception of the idea for it to a finished and tested version. By 
product is meant anything created through a development process, whether 
it be in the form of material objects, of procedures, or of programs. 

Ordinarily development concerns the creation and testing of ''prototype models." 
Where different versions of the product are created, this too is development. 
Wide-scale production, testing, and distribution of a product falls under 
diffusion rather than development. 

A confusion can result from the fact that one can develop research methods, 
diffusion procedures or materials, and evaluation procedures and materials. 
This simply illustrates the fact that the "linear model" does not correspond 
to reality since rarely does the process research-to-development-to-dif f usion- 
to-evaluation run the course implied by this sequence. 



DIFFUSION covers any aspect of the processes of promoting or facilitating the 
wide-spread utilization of a product that has been developed through the 
prototype-model stage. Diffusion may be separated into components bearing 
the labels field testing , demonstration , and dissemination . Two other terms 
falling under diffusion are production and marketing . 

Field Testing involves implementing the product in different types of settings 
to determine its appropriateness to the needs and resources of the various 
settings and to work out ways of adapting the product for use in different 
settings. Field testing often requires major prograi.is lo train local personnel 
to implement the product. 

Demonstration involves implementing the product in one or more settings and 
providing opportunities to observe it in action. A demonstration installation 
also can be used to provide intern training, if desired. 

Dissemination consists of spreading information about a product through any 
communication channeJ. — talks, written materials, films, video-tapes, visits 
to demonstration or field-test sites, etc. 

Prc<luction refers to making multiple copies of the product in finished form, 
with the purpose of providinr, enough copies to satisfy the ,:aiket for the 
product. 

Marketing refers to building in potential users a readiness to adopt the 
product and to building a distribution network to iiupply adopters. 
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UTILIZATION refers to the design and conduct of local change programs that 
are intended to improve instruction or the conditions under which it is 
conducted. Utilization is consumer-, rather than product-oriented. It 
should arise out of recognition of a need for improvement and should 
involve incorporating in the change program those innovations judged to 
offer most toward meeting the need Within the resources available). 

Adoption refers to utilizing a designated innovation within the local 
change program. 

Adaptation refers to modifying a product to suit the characteristics of 
the local school system — its student body, its staff, its community, its 
material resources, etc. 

EVALUATION covers any instance where something is measured in its relation 
to a criterion. Simply measuring something using an appropriate instrument 
or procedure is not evaluation since this is not determining the extent to 
which a criterion is satisfied. A common usage is to distinguish formative 
and suramative evaluation. 

Formative evaluation is used to assist in the development of a product. 
Especially useful is evaluating the extent to which the stage of develop- 
ment or implementation of the product satisfies the criteria set in the 
development plans. Such evaluative evidence is used as "feedback** informa- 
tion to help in modifying the product design or the implementation approach. 

Summative evaluation consists of measuring outputs delivered by the product 
in terms of the criteria set by the intended outputs. 

T3st Development is a special area of evaluation that covers the design, 
construction, and assessment of measuring instruments. Such instruments 
are especially needed in assessing student achievement of curriculum objec- 
tives and in diagnosing student input characteristics. 

RESEARCH is the systematic study of relationships between or among variables 
with the purpose of arriving at generalizable knowledge of such relationships. 
When research studies are theory-based, they test hypotheses. When research 
confirms an hypothesis it becomes a principle or law or rule. 

The distinction between basic and applied research is useful even though it 
often is hard to determine under which of these labels a given study falls. 
The emphasis in basic research is on arriving at highly generalizable know- 
ledge about the relationship of variables. The emphasis in applied research 
is on obtaining knowledge that can be put to use in solving practice problems 
(the knowledge then provides a basis for engineering a solution). 

Sometimes basic research findings are translated directly into applications. 
Thus research on reinforcement schedules has provided the basis for **contin- 
gency management" in-classrooms. At other times, basic research theory and 
findings orient efforts to engineer solutions even though they are not spec- 
ifically translated into practices. Thus research on the effects of positive 
and negative reinforcement has provided a basis for "accentuating the positive 
and "eliminating the negative," though the ways of doing this have to be 
worked put with little help from the research findings. 
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DESIGNS OF THE TRAINING PROGRA***^. 



Introduction 



This section of the report gives a description of the training programs 
that will be developed, implemented, and assessed during the operational phase. 
The work of the operational phase, during the first year, will focus on devel- 
oping and initiating trai'^ing in two major areas of innovation — curriculum 
development and the design and conduct of local change programs. During the 
second year of the operational phase, it is intended to develop and initiate 
two additional program areas — development of training programs, and develop- 
ment of instructional environment systems. These additional specialities 
in the general area of development overlap markedly with curriculum development 
and can be added the second year without involving major additional demands on 
project resources. 

The four programs to be launched during the initial year (February 1, 1971 
January 31, 1972) are the following: 



Program 1. Short-term Program to Train Professional Assistants to 
Build Curricular Materials 



Program 2. Long-term Program to Train Project Directors and Profes- 
sional Assistants in Curriculum Development 

Program 3. Short-term Program to Train Project Directors to Design 
Local Change Programs 

Program 4. Long-term Program to Train Project Director and Professional 
Assistants to Design and Conduct Local Change Programs 



The choice of curriculum development, and utilization - local change 
programs, as the two areas in which training will be offered was made for^^ 
several reasons. Curriculum development can be considered the most funda- * 
mental approach to instructional innovation inasmuch as it involves basic 
decisions about both the ends and the means of instruction. It offers 
answers to key questions about what is to be taught to whom and how . The 
choice of offering training to design and conduct local change programs 
also is strategic. The pay-off of the processes of instructional innovation 
is found in changes in the instruction provided students. Local change 
programs provide the route for bringing innovations into the schools. 

A second reason for picking the twc areas is the fact that they involve 
all aspects of the instructional program viewed as a system of interacting 
components. Both involve decisions about the ends to be served and about 
how the various components of instruction are to be involved in serving 



A third reason for choosing curriculum development and local change 
programs as the initial training areas is the fact that, taken together, 
they require developing training units and materials that cover the great 
bulk of the tasks in the List of Tasks in Educational R&D (Appendix A). 
Curriculum development involves also teacher training, changes in the in- 
structional environment, test development, formative and summative evaluation. 
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strategic research studies, and competencies in project management. Local 
change programs involve changing curricula and instructional procedures, 
initiating new teacher training, and employing competencies in evaluation 
and in project management. Also, they involve many tasks in the area of 
diffusion (field testing, demonstration, and dissemination). 

A fourth reason for the choice is that these two areas are ones in 
which the consortium possesses exceptional strength. Curriculum development, 
with particular attention to individualized instruction, is strongly repre- 
sented in the work of the Learning Research and Development Center (LRDC) 
and Research for Better Schools (RBS) . Several other Consortium agencies, 
notably the American Institutes for Research and Applied Science Associates, 
are particularly strong in this area. Expertise in designing and conducting 
local change programs is especially well represented in the Pennsylvania 
State Department of Education, in the work of RBS in diffusing the program 
of Individually Prescribed Instruction (IPI), in the innovative programs of 
the school systems in the Consortium, and in Project Follow Through at LRDC. 

The decision has been made to provide training initially for two sorts 
of positions in educational R&D agencies — Project Director (PD) and Pro- 
fessional Assistant (PA). As was stated in Part I of this report (see 
page 14), training of Technical Assistants (TA) and Para-Professionals (PP) 
will not be provided during the first year or so of the operational test. 
As needs for training personnel to fill such positions become evident, and as 
training units appropriate for such positions are located or built in connection 
with the initial four training programs, training programs for TA's and PP's 
may be introduced* 

Each of the four training programs includes work in four types of 
training contexts. These are course work, laboratory exercises or projects, 
internship experiences, and individualized training program guidance. The 
guidance aspects of the trainee's program, under an assigned adviser, through 
program planning and advisement provide a match-up of the trainee's needs and 
learner characteristics, on the one hand, and training tasks presented through 
course work, labs, and internships, on the other. Generally, course work and 
labs precede, and provide a foundation for, internship experiences. However, 
interaction of the different approaches to training is given explicit attention 
in the design and conduct of each trainee's program. 

Associated with the types of training contexts are tlie types and levels 
of training offered in a given task or task area. These have been presented 
in detail on pages 9 - 11 of Part I of this report. They are presented in 
summary form on the page that follows to assist the reader in following the 
entries on Lev3l of Training in the descriptions of the four training programs. 
Note that the types of training that can be offered for a task cover the range 
from course work through labs to internship or job experiences. 

A word should be said about the general strategy of training program 
development being followed. This proposal represents a practical approach 
to introducing training in areas where, heretofore, virtually no training 
has been offered. The Consortium might have undertaken the task on a piece- 
by-piece basis, developing the needed training units to a high level of 
techn-^cal refinement before venturing to implement the programs. Instead, 
the plan is to launch the program with the best approaches and materials 
that are available while proceeding at all times to improve the quality of 



SUMMARY OF TYPES AND LEVELS OF TRAINING IN TASKS OR TASK AREAS 



The following is a summary characterization of the types and levels 
of training that will be made available for tasks or task areas for which 
training materials will be provided. The characterization offered here 
specific training objectives for each level abbreviating the information 
given in the fuller description appearing on pages 9-11 of Part I of this 
report. 

Generally, the sequence as presented below constitutes an hierarchy; 
when a given level of training is stated for a task, it means that the 
preceding levels also have been covered by the trainees involved. The 
major exception is that training at the job level (J) can occur following 
training that reaches only to the PI or P2 level as well as following 
training that reaches the T level. 



Train ing 
Level 



Training 
Type 

Core - 

Introductory 

Core - 
Advanced 



Symbol Training Objectives 

CI Can describe general content of task or task 

area and state types of problems found there 

C2 Can state body of facts, principles, and 

guidelines in the task (or task area) but 
cannot apply these in solving real problems 



Analysis 
of tasks 



Can analyze task products r£ variables and 
interactions of tasks that are critical for 
task performance and its evaluation 



Practice - PI Works simplified problems that teach basic 

Elementary skills and knowledge and their application 

to basic problems 

Practice - P2 Works problems approximating the complexity 

Advanced of the real world but not requiring inter- 

action with people there 



Theory and 
Transfer 



Job-like 
practice 



Can independently apply principles and methods 
to the solution of real problems with no 
supervision or review required 

Learns to solve problems in the real world, 
and shows both technical competency and the 
ability to cope with interpersonal factors 
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the approaches and materials employed. Thus it will be necessary to rely 
heavily on relatively unsystematic training materials and approaches in 
the form of study guides, selected readings, and seminar discussions. As 
development activitie?? proceed within the Consortium and elsewhere, an 
increasing ♦body of carefully-structured training units will become avail- 
able for replacing the earlier and less-adequate units. An advantage of 
the strategy of program development being employed is that, by venturing 
into the training arena before adequate training materials are at hand, 
a setting for tryout and revision through formative evaluation dealing 
with a wide range of training problems is provided. 

The accounts of the four training programs given on the succeeding 
pages each follows a common format. After an introductory section, 
contents of the program are identified in terms of task areas and tasks, 
and level of training. Then follows a brief description of how the program 
will be conducted. It is obvious that these specifications on content 
and conduct of the programs are tentative and subject to major change 
when the programs are developed. Finally, for each program, the expected 
number and sources of trainees for the 1971-72 year is indicated. 

After the descriptions of the four training programs, this part of 
the report concludes with sections on individualizad trainee guidance, on 
implementing the training programs, and on evaluation of the work of the 
operational phase. 
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PROGRAM !• SHORT-TERM PROGRAM TO TRAIN PROFESSIONAL ASSISTANTS TO BUILD 
CURRICULAR MATERIALS 



Purposes and Jastif ication for the Program 

A major portion of the work in curriculum development performed by 
agencies such as Research and Development Centers, Regional Educational 
Laboratories, curricultan departments in large school systems, university- 
based project teams, and publishing houses is that of building curricular 
materials in the form of units or lessons. Most of this work can be, and 
usually is, performed by what we are calling Professional Assistants 
(research assistants, interns, etc.) who work under the supervision of 
the director of a curriculum project or sub-project. 

While Professional Assistants engaged in curriculum development would 
become fully prepared for their jobs only through an extensive training 
program, it is practicable to offer a short-term program that concentrates 
on the relatively circumscribed set of competencies required to build 
curriculum materials after the major decisions on design and content have 
been made* In the present program, the Professional Assistant will start 
with a set of pre-determined learning objectives. His work in building 
units, for the purposes of this short-term program, will stop after the 
initial tryout and revision of the units he builds. 

The justification for a short-term training program of this sort is 
that, each year, hundreds — perhaps thousands — of Professional Assistants 
are employed in curriculum development projects across the country with 
little or no specific training for their jobs. Generally, the on-the-job 
training of these new assistants is unsystematic, decentralized, and highly 
uneven from agency to agency, project to project. Under these conditions, 
learning to do the job takes longer than necessary and requires much more 
time from supervisors than should be used. Often, also, the assistant 
never reaches a high level of proficiency be ,ause of lack of adequate 
training. 



Products Intended 

Products of the development and tryout of Program 1 will be several. 
An immediate gain will be the improved performance of trainees in the 
program as they begin (or continue) work in their positions. Of greater 
general significance, tested training components will be generated in 
this vital area of development. These units can be made available for use 
in any R&D agency that is engaged in curriculum building. Also, these 
components will form a substantial part of the major program under devel- 
opment by this Consortium to train specialists in the development of 
curricula — Program 2. 
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Initiation of the Program 

Program 1 will be launched by offering training to Professional 
Assistants engaged in curriculum development at the Learning Research 
and Development Center, Research for Better Schools, the Pennsylvania 
State Department of Education, and to similar personnel in other Con- 
sortium agencies or elaev/here. In some instances trainees will be 
newly-hired; in other instances, they will already have had some job 
experience in curriculum building. 

The program will be initiated during the summer of 1971, and will 
begin with a four- to six-week full-time institute. Training will con- 
tinue during the fall months with supervised job experience and with a 
bi-weekly training day, September - December. The institute will offer 
training in Educational R&D Foundations and basic training in building 
curricular units. The in-service continuation of the program will ensure 
that the basic training is applied effectively on the job. 



Content of Program 1 

Content to be included in Program 1 can be represented by listing the 
tasks for which training will be provided and, for each task^ the level to 
which it is to be mastered. For explanation of the symbols for these levels, 
reference is made to the summary description offered in t\ie introduction to 
this part of the report. 

The tasks identified below are from the List of Tasks in Educational 
R&D ; they are stated in abbreviated form. All entries under Level of 
Training apply to preparation for positions as Professional Assistants. 



TASK AREAS AND TASKS 



LEVEL OF 
TRAINING 



DEVELOPMENT: CURRICULUM OR TRAINING PROGRAMS 



I. Arrive at general 
program objectives 



1. Identify need for program 

2. Judge importance, feasibility 

3. Identify classes of objectives 



> 



II. Specify instructional A. Specify terminal objectives 
objectives 5. Analyze terminal objectives 

6. Set up sequences, units. . , 

7. Make tests, observational 
schedules 



C2 



. A 
P2-J 



III. Design and build 
the program 



8. Formulate instructional strategies A 

9. Prepare instructional materials p2-J 

10. Test materials on a few subjects P2-J 

11. Interpret test data, revise p2-J 
materials 



ERLC 



EVALUATION: C. TEST DEVELOPMENT 



LEVEL OF 
TRAINING 



I. Arrive at purposes 
of the test 



1. 
2. 



Define purposes, uses of the test 
Prepare content, behavioral specs. 



II. Plan the test 



3. 
4. 
5. 
6. 



Survey limits for use, administration 
Develop scoring procedures 
Determine test length 
Plan item construction 



> A 



III. Build the test 



7. 



Develop items, directions 



IV. Try the test 



8. 
9. 



Plan tryout stages 

Tryout the test (alternate forms) 



EDUCATIONAL R&D FOUNDATIONS 

1. Define and relate educational development, diffusion 
utilization, evaluation, and research 

« 

2. Describe functions, programs, and roles of types of 
educational R&D agencies 

7. Specify the requirements for building a programed 
instructional unit 

8. Specify the requirements for instructional programs 
representing individualization, mastery, and student 
self-direction 

10. Specify the instructional requirements for teaching 
inquiry (problem-solving) 

13. State various types oi learning objectives in terms 
of student behaviors 

lA. Demonstrate knowledge of learning theory concerning 
concepts, principles, discrimination, transfer, 
motivation, and reinforcement in relation to instruction 



C2 
C2 
C2 
C2 

C2 
PI 
C2 



SOCIAL/PERSONAL COMPETENCIES 



A. Inter-personal 



B. Work Habits/Attitudes 




* The J, in this instance, applies to performance in any part 
of the training program since judgments of personal/social 
competencies can be made both during the institute and on 
the job. 
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Conduct of Program 1 

forth'jr^hfp'"" '"/"S"*" ^ f generally follow the guidelines set 
forth in the Resnick strategy for training to prepare instructional 
n>aterials (see Appendix C. pages 5-8). The general sequence of Jrainin. 
cZllZT beginning with the summer institu e and ' 

continuing with on-the-job supervision and bi-weekly training days. 

SUMMER INSTITUTE 

,Weeks L^vel of 

^^EEI22i) Content Training Media 

1 R&D Foundations, Tasks 1,2,8,10 C2 Pi/Rde /Sem 

Development: Curriculum, Tasks 1-11 ci Pl/^tl'iilT 

Development: Curriculum, Tasks 1-5 c2 ll/sZlZ 



1-2 



Anltic?f "f\^""^'"^"'"' ""^'^ ^ (sequence, units) A Seminar/Lab 
Analysis of instructional materials a Seminar/Lab 

1-2 R & D Foundations, Task 13 (behavioral defs.) pi Pi/Lab 

Editing instructional materials pi Seminar/Lab 

i-2 Evaluation: Test Development, Tasks 1-9 a PT/SPm-in:,^ 

Formulate Instructional Strategies a Pi/Lab 

Build, test, revise instructional materials P2 Seminar/Lab 

On-the-job Instruction. Following the completion of the institute 
trainees will receive individual instruction on-the-job from their job ' 
supervisors. This instruction will be correlated vith that offered in 
the institute and will have the purpose of facilitating the application, 
on the job, of the competencies learned in the institute. To assist job 
supervisors in performing this function, they will be provided with guide- 
lines and supporting materials for assessing and analyzing the trainees' 
personal/social competencies on the job, and for offering counselinp to 
remedy deficiencies. 

. Bi-Weekly Training Days. Following the completion of the institute 
trainees will attend a one-day workshop every two weeks for two and one-half 
months, a total of five additional training days. These workshops will have 
che purpose of integrating institute training with job performance through 
study of case data derived from trainees' curriculum building work and 
through refresher training units involving key aspects of curriculum building 
that were covered in the institute. 



ERIC 



Trainees for Program 1 

During the initial implementation of the program during 1971-72, it is 
planned to have 10-15 trainees. It is anticipated that 4-6 will be from 
the Learning Research and Development Center, 2 from Research for Better 
Schools, and 4-6 from the Pennsylvania State Department of Education. Two 
or three trainees may come from other Consortium agencies. Community 
organizations such as the Bidwell Culture and Training Center, Model Cities, 
and the Urban League, all of Pittsburgh, plan to provide one or more trainees. 
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PROGRAM 2. LONG-TERM PROGRAM TO TRAIN PROJECT DIRECTORS AND PROFESSIONAL 
ASSISTANTS TO DEVELOP CURRICULUM 



Purposes and Justification for the Program 

This program Is designed to provide systematic training for persons 
who will hold key roles In curriculum development projects. Few carefully 
designed programs presently exist In this area. (An example of the few 
exceptions to the rule Is Leslie J. Brlggs, Handbook of Procedures for the 
Design of Instruction , American Institutes for Research, 1970). The present 
program will offer two or three years of full-time training leading to the 
masters or doctoral degree, or to equivalent certification. The Intent Is to 
provide the trainee with a professional basis for making key decisions about 
Instructional goals and methods, and with expertise In designing. Implementing, 
and assessing curricula In different subject-matter fields that are Intended 
for different student populations. Stress will be placed on learning to make 
curriculum decisions that are relevant particularly to critical problems 
involving educationally disadvantaged groups In our society. Types of learning 
goals that will receive systematic attention in the program are tool skills 
In language and mathematics, competencies In self-directed learning. Inquiry 
(problem solving), and personal/social attitudes and competencies. Trainees 
will learn to build into currlcular materials provisions for the use of 
Instructional approaches and media that are suitable for Individualized 
instruction. 

Justification for this program Is found In the fact that thousands of 
persons lacking specific prior training for their jobs now are employed In 
curriculum development projects and, further. In the fact that each year 
more thousands enter such jobs without relevant training and must learn 
their roles on-the-job in an apprentice capacity. Curriculum projects 
calling for experts to fill roles as project directors or professional 
assistants are Illustrated by LRDC^s IPI and PEP programs, the Humanizing 
Learning Program at RBS, Project PLAN of AIR and Westlnc'-iousa Learning 
Corporation, Science - A Process Approach by AAAS, and Man - A Course of 
Study originated at the Educational Development Center. Much work in 
curriculum development goes on In universities. In school systems. In state 
education departments, and In the education Industry. Program 2 offers 
training for jobs in all such projects and agencies. 

Special contributions of Program 2 to the upgrading of curriculum 
development will come from It emphases on training for the Introduction 
of different kinds of learning goals Into the curriculum (self-direction, 
inquiry, etc.), on ensuring that curriculum content Is relevant to the 
needs of different student sub-populations, and on providing materials 
that are suitable for Individualized Instruction. Also, Program 2 will 
offer training In taking account of curriculum as part of an Instructional 
system that Includes the learning environment and requires teacher education 
that is appropriate to curriculum objectives. 



- 10 - 



Products Intended 

It is intended that the development of Program 2 during the operational 
phase will yield a tested design for training leaders in curriculum develop- 
ment together with training procedures and materials that can be employed in 
various pre-service and in-service settings. The initial test of the program 
during the operational phase thus can provide the launching pad for diffusing 
all or part of the program to other training sites. A small number of 
trainees will be accommodated during the pilot test of the program. This 
number can be significantly increased with the same funding once the emphasis 
shifts from program and materials development to training. 

Initiation of Program 2 

It is planned to introduce Program 2 in the fall trimester of 1971-72 
at the University of Pittsburgh. The initial group of trainees, recruited 
from across the country, probably will consist mainly of graduate students 
enrolling for the two-year, masters level, course of training. A few 
probably will enroll for the three-year, • doctoral level, program. During 
the first year, 1971-72, all trainees will engage mainly in course work and 
laboratory activities with internship experiences occurring the second year 
and beyond. 

Content of Program 2 

The content of Program 2 is represented, as was that of Program 1, by 
listing task areas and tasks to be covered and indicating for each task or 
group of tasks the level to which it is to be masted. Note that, in Program 
2, provisions are made for the training both of Project Directors (PD) and 
Professional Assistants (PA). It will be seen that, with many tasks, both 
categories of trainees will be called upon to achieve mastery at the same 
level. This is on the assumption that prospective Professional Assistants 
differ mainly from prospective Project Directors in the length of their 
training programs, in their preparation to manage projects, and in whether 
or not they intend to conduct a major original project during their training 
as a requirement for the doctorate. 

Once again, the reader is reminded that the task areas and tasks listed 
for Program 2 are from the List of Tasks in Educational R&D (Appendix A) 
and that the ^ymbols for level of training are explained on page 3 above. 
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LEVEL OF TRAINING 



DEVELOPMENT ! Curriculum or Training Programs 



PD 



PA 



I. Arrive at general 
program objectives 



II. Specify instructional 
objectives 



III. Design and build 
the program 



IV. Build instructional 
environment 



V. Build teacher/staff 
training program 

VI. Pilot test the 
program; revise, 
retest 



1. 
2. 
3. 

A. 
5. 
6. 
7. 

8. 

9. 
10. 
11. 



Identify need for program 
Judge importance, feasibility 
Identify classes of objectives 



Specify terminal objectives 
Analyze terminal objectives 
Set up sequences, units 
Make tests, observational schedules 



jt-j 

\ 

f T-J 



12. Design needed instructional 
environment 

13. Prepare materials for environment 

lA. Identify teacher/staff behaviors 
15. Prepare training materials 



VII. Report findings 



16. Design pilot test of program 

17. Conduct pilot test 

18. Analyze, interpret feedback data 

19. Revise curriculum/training program 

20. Revise instructional environment 

21. Revise training program 

22. Retest revised program on pilot 
basis 

23. Prepare report on the program 



} 

1 



Formulate instructional strategies'^ 
Prepare instructional materials 
Test materials on a few subjects 
Interpret test data, revise 
materials 



P2-J 



P2-J 



Ref, Ins true. 
Envir. Systems 



Ref Tasks 1-11 



P2 



P2 



ERiC 
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LEVEL OF TRAINING. 
PD PA 



DEVELOPMENT: Instructional Environment Systems 



I. Arrive at objectives 
for program 



II. Develop strategy for 
building the system 



III. Build the system 



IV. Provide curriculum 
to implement system 

V. Provide training 
program for teachers 

VI. Pilot test the system; 
revise, retest 



1. Identify need for program 

2. Judge importance, feasibility 

3. Identify purposes to be served 

4. Specify objectives of the environment 

5. Specify features of required 
environment 

6. Specify ways to incorporate features 

7. Analyze the alternative ways 

8. Select an alternative 

9. Determine resources required 

10. Develop the system ^ 

11. Identify curriculum needs 

12. Build the curriculum 

13. Identify teacher behaviors 

14. Build teacher education program 



15. Design the pilot test 

16. Conduct the pilot test 

17. Analyze and interpret feedback data 

18. Revise environment system 

19. Revise curriculum for system 

20. Revise training program for system 

21. Retest system on pilot basis 



C2 



VII. Report findings 



22. Prepare report on the system 



See work flow 
for curriculum 
develonment 



y C2 



CI 



X 



ERIC 



I 

I 



I 



ERLC 
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LEVEL OF TRAINING 
PD PA 



DIFFUSION: Field Testing 

I, Arrive at general 
program objectives 



II, Specify required 
product adaptations 

III. Prepare to conduce 
the field test 



IV. Conduct and assess 
the field test 



V. Prepare a report 



1. Select and describe field test 
product 

2. Specify purposes of field test 

3. Identify sub-populations of users 

4. Identify needed modifications 



5. Design needed product modifications 

6. Great and test the modifications 

7. Design changes in Implementing product 

8. Develop and test these changes 

9. Develop assessment program for 
product Implementation and outcomes 

10. Select settings for the field test 

11. Secure coopera'-^lon from test sites 

12. Select, train field testers 

13. Conduct the field test 

14. Revise program or its implementation 

15. Repeat the field test 

16. Analyze and report data on field test, 
recommending changes to developer or 
producer ^ 



C2 



DIFFUSION : Demons tratlon 



I. 


Arrive at general 


1. 




program objectives 








2. 


II. 


Plan for types of 


3. 




demonstration 


4. 


III. 


Design plan for 


5. 




demonstration 


6. 


IV. 


Prepare for and 


7. 




conduct demonstration 


8. 






9. 






10. 






11. 






12. 


V. 


Prepare a report 


13. 



demonstrate 



recommending product modifications to 
developer or producer ^ 



C2 
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DIFFUSION: Dissemination 

I. Arrive at program 
obj ectlves 



II • Plan the dissemination 
prograia 

III, Build and test the 

dissemination materials 



IV, Conduct and assess 
the dissemination 
program 



V. Report findings 



1. Identify dissemination need 

2. Judge Importance, feasibility 

3. Specify dissemination objectives 

4. Identify target population 

5. Formulate dissemination strategy 

6. Develop dlssemlr-^tlon materials 

7. Develop evaluat^jn Instruments 

8. Pretest prototype materials 

9. Revise materials 

10. Implement the dissemination 
program 

11. Assess program effectiveness 

12. Revise the program, repeating 
steps 10 and 11. 

13. Prepare a report of findings, 
with recommendations to 
producers and marketers of 
the product 



LEVEL OF TRAINING 
PD PA 



> A 



C2 



ERiC 
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UTILIZATION : Local Change Programs 



LEVEL OF TRAINING 
PD PA 



I. Arrive at program 
obj ectives 



II. Plan the local 
change program 

III. Conduct and assess 
the change program 



IV. Report findings 



1. Specify objectives of program area 

2. Assess present accomplishment of 
objectives, identify shortcomings 

3. Assess resources available for 
improving accomplishment of 
objectives 

A. List relevant change programs 

5. Assess costs of these change 
programs 

6. Assess local resources, constraints 

7. Rank order potential change programs 

8. Select the change program ^ 

9. Design the change program 

10. Design program to assess change prog. 

11. Obtain the required resources 

12. Conduct pre-implementation activities 

13. Implement the change program 
lA. Analyze, interpret feedback data 

15. Revise program, implement again 

16. Prepare report on program effective- 
ness with recommendations for use ^ 



CI 



1 
I 
I 
I 

ERIC 
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EVALUATION 
A. Formative 

!• Context evaluation 



II. Input evaluation 



III. Process evaluation 



IV. Product evaluation 



B, Summative 

I. Arrive at purposes 
of the evaluation 



II. Develop evaluation 
plan 



III. Conduct the 
evaluation 



IV. Report findings 

C, Test Development 

I. Arrive at purposes 
of the test 

II. Plan the test 



III. Build the test 
IV. Try the test 



V. Analyze data and 
revise test 



1. Identify present goals of system 

2. A$sess value of goals 

3. Plan for assessing goal achievement 

4. Assess current goal achievement 

5. Identify problem area 

6. Identify goals of development effort 

7. Evaluate the development goals 

8. Specify how to assess goal attainment 

9. Evaluate plans for achieving goals 

10. Assess program implementation 

11. Monitor program structuring 

12. Further monitor program implementation 

13. Assess degree of attainment of goals 

14. Prepare evaluation reports j 



1. Specify characteristics to evaluate ^ 

2. Specify purposes of evaluation effort 

3. Identify dimensions to be evaluated 

4. Identify data collection means 

5. Analyze and compare the alternatives 

6. Select data collection approach 

7. Develop procedures for data analysis 

8. Evaluate constraints re procedures 

9. Modify procedures re Step 8 > X 

10. Plan evaluation study activities 

11. Conduct pre-study activities 

12. Conduct evaluation data collection 

13. Analyze data 

14. Interpret findings 

15. * Prepare a report with recommendations 



LEVEL OF TRAINING 
PD PA 



J 



ERIC 



VI. Report finding. 



1. Define purposes and uses of the test 

2. Prepare content, behavioral specs. 

3. Survey limits for use, administration 

4. Develop scoring procedures 

5. Determine test length 

6. Plan item construction 

7. Develop items, directions 

8. Plan tryout stages 

9. Tryout the test (alternate forms) 

10. Analyze data from tryout 

11. Recycle if data calls for it 

12. Prepare final version of test 

13. Prepare technical report, test manual 



i 
I 
I 
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RESEARCH 



LEVEL OF TRAINING 
PD PA 



I 



I* Formulate research 
hypothesis 



II • Design the 
research plan 



III. Conduct the 
study 



IV* Analyze data and 
prepare report 



1. Select the topic and variables ^ 

2. Review previous related theory 
and research 

3. Identify situational factors 
that limit the approach • 

4. Specify problem £e variables 

5. Predict variable relationships 

6» Plan the research approach 
7« Assess feasibility of plan 

8. Define variables re operations 
and measures 

9. Identify subject population 
10» Specify the research design 

11. Modify design to constraints 

12. Plan to implement the design 

13. Conduct pre-research activities 

a. train personnel 

b. confirm validity of procedures 

c. conduct liaison/logistics 

d. revise design as needed 
lA. Implement research plan 

15. Monitor operations for problems 

16. Change design to overcome 
difficulties 

17. Complete data collection 

18. Transfer data to appropriate 
form for analysis 

19. Implement statistical analysis 

20. Depict findings with graphs, etc. 

21. Summarize, interpret and report 
findings ^ 



A 



ERIC 
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LEVEL OF TRAINING 

EDUCATIONAL R&D FOUNDATIONS PD pa 

1. Define and relate educational development, diffusion, Q2 C2 
utilization, evaluation, and research 

2. Describe functions, programs, and roles of types of C2 C2 
educational R&D agencies 

3. Demonstrate competence in search skills in locating pi Pl 
educational R&D information 

4. Describe the features of the educational reform C2 C2 
movement in the U.S. since 1955 

5. Describe instructional systems in terms of their major C2 C2 
components 

6. Compare or contrast two or more instructional systems A A 
in terms of how their components are represented 

7. Specify the requirements for building a programed 
instructional unit 

8. Specify the requirements for instructional programs 
representing individualization, mastery, and 
student self-direction 

9. Compare and contrast instructional systems in»'term8 
of the degree to which they involve individualization, 
mastery, and student self-direction 

10, Specify the instructional requirements for teaching q2 c2 
inquiry 

11, Compare and contrast curricula and instructional a A 
approaches in terms of the extent to which they are 
appropriate for teaching inquiry 

12, Describe school /community relationships in terms of c2 C2 
their impact on instructional programs 

13, State various types of learning objectives in terms p2 A. 
of student behaviors 

14, Demonstrate knowledge of learning theory re concepts, c2 C2 
principles, discrimination, transfer, motivation, 
and reinforcement in relation to instruction. 



15, Demonstrate knowledge of the relationships of 
basic and applied research to instruction 



C2 C2 
C2 C2 



C2 C2 



erJc 
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SOCIAL/PERSONAL COMPETENCIES 
A* Interpersonal ^ 

1. Inform co-workers effectively 

2. Request needed information, help from co-workers 
3* Assist co-workers and accept their assistance 

4« Contribute ideas to group planning 

5* Assess one's competencies in contributing to group 

6. Accept, perform different roles in group 

7. Contribute to work flow of the group 

8. Evaluate group performance, suggest improvements 

9. Contribute to positive interaction of group members 

B. Work Habits/Attitudes 

10. Perform and complete work on schedule 

11. Accept and assume responsibility for work 

12. W>rk independently 

13. Subordinate personal interests to work requirements 

14. Maintain professional ethics in work activities 

15. Show Interest in work as by Improving competencies, 
participating in professional organizations 



LEVEL OF TRAINING 
PD PA 



/ 
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PROJECT MANAGEMENT 



I. Plan the project 



II. Build budgets 
and contracts 



III. Build manpower 
resources 



IV. Supervise project 



V. Communicate 
information 



LEVEL OF TRAINING 
PD PA 



1. State objectives as products » 
processes 

2. Select a planning technique 

3. Diagram activities flow 
A. Estimate staff, funds, time, etCi 

needs ^ P2-J 

5. Define staff roles and organization 
6« Plan needed external Interactions 

7. Prepare project plans w. deadlines 

8. Establish planning feedback mechanism 

9. Periodically assess plan effectiveness 
10. Revise plan or components as needed j 



PI 



11. Identify funding sources 

12. Estimate project coffts 

13. Analyze organization/funding for 
compliance to relevant guidelines 

lA. Prepare detailed budget 

15. Select a cost control system 

16. Prepare formal contracts 

17. Procure facilities, equipment 

18. Recruit and select staff 

19. Orient staff to the project 

20. Assess staff training needs 

21. Select, design training experiences 

22. Conduct staff training 

23. Build working relations with 
other project /agencies 



J 



C2 



C2 



> P2 



PI 



2A. Make assignments 

25. Delegate authority 

26. Maintain quality/efficiency standards 

27. Parcel work to other project /agencies 

28. Adjust excessive/Insufficient work 
loads 

29. Provide appropriate reinforcement 

30. Maintain accountability mechanism ^ 

31. Develop communication network within 
agency 

32. Periodically report progress to 
admlnlstrators/funders 

33. Explain decisions to staff 

3A. Develop liaison with Interested groups* 
Individuals 



P2-J 



PI 



> PI 



PI 
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Conduct of Pr o gram 2 

The heart of Program 2 is found in the work flow for DEVELOPMENT: 
Curriculum or Training Programs (see page 11 above). The most critical 
parts of this work flow are Tasks 1-11 covering the arriving at general program 
objectives, specifying instructional objectives, and designing and building 
the curriculum. Tasks 12 and 13 on building the instructional environment 
call for study of Tasks 1-10 of the work flow for Development: Instructional 
Environment Systems . Tasks 14 and 15, on teacher training for the curriculum 
that has been developed, simply calls for re-cycling through Tasks 1-11, this ^ 
time to develop the required teacher education sub-program. Tasks 16-22 
involve pilot testing, revising, and retesting the curriculum/instructional 
environment/ teacher education components. Extensive training for these tasks 
is not necessary beyond the analysis level since there is much overlap with 
earlier tasks. Actually conducting a pilot test of a curriculum would be 
highly desirable; however it is unlikely to be feasible within the internships 
that can be made available. Training at the analysis level will be offered 
and, if opportunities occur to engage in pilot testing in an internship, 
they will be used. Task 23 on preparing a report can be taken care of in a 
laboratory setting with simulated case data. 

In reviewing the task coverage for this program, it should be noted that 
all tasks in all the work flows are in the training program at lea - t at the 
core (CI or C2) level . (A major job of program development is to build training 
materials for the core levels that introduce the trainee to the full scope of 
educational R&D represented by the task list in Appendix A.) Many of the 
tasks are to be studied at the analysis (A) level as is the case with the 
three work flows in Evaluation. Obviously, trainees will receive evaluation 
training at a higher level in those tasks of the curriculum development work 
flow involving assessment competencies (Tasks 2, 7, 10, and 11 on page 11, 
in particular.) 

During 1971-72, the first year of training. Program 2 will be conducted 
almost entirely through course work, field observation, and laboratory activ- 
ities. Details on how these will be interlaced to provide the pre-internship 
coverage of tasks must be worked out as part of the process of specific program 
development to be launched in February 1971, if the project is funded. At 
this time, general guidelines that probably will be followed can be indicated. 

The first major objectives to be accomplished in the program concern 
Tasks 1-3 of the curriculum development work flow. Training in these tasks, 
beginning at the core levels, will involve concentrated work on R & D 
Foundations (see page 18) to provide bases for identifying curriculum issues, 
for locating needs for curriculum development, and for deciding upon general 
classes of learning objectives that relate to meeting the needs that have 
been identified. In this introduction to the program, in addition to reading 
and taking part in seminars, trainees will visit communities and schools to 
conduct planned observations and interviews designed to acquaint them with 
educational issues and the ways in which instructional programs do or do not 
deal with them. 
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He^thli! 'V^S^^'f'' approach to instruction in Tasks 1-3 recommended by 
Heathers (Appendix C. pages 1-3) indicates the sorts of curriculum units 
(programed, syllabus and readings, seminars, and labs) that can 

ZirdP.. m"?^"^ '° ^''^^^^ curriculum materials. Such units set 
forth desirable features of curricula with respect to learning goals 
instructional approaches, provisions for student differences, and pro- 
visions for facilitating implementation. They proceed to the examination 

iSentln'^'"^ °l T'^' ''''''''''' '"-"^ °f '"'^h criteria anHhe 
identification of shortcomings in existing curricula (Task 1). After 

(?Isk 2)°M;^ r "'^'^"'^^J/i^h judgments of importance and feasibility 
(Task 2). the trainees will proceed to work on approaches to specifying 
how new curricula could account for needed learning goals, instructional 

Uatw ''''''''' differences, and provisions for acil- 

itating implementation (Task 3) . '■•ii-ix 

nthp.^"^u^^? '^^^^^ ^"^ "^^^ accompanied by core units covering 
diffusion ( ie^Id ^ '^f list-instructional environment systems? 
tlliT f f jesting, demonstration, and dissemination), and utili- 

survey will be to provide an orientation to the general contexts in 
which curriculum development proceeds. ':«n«-exts m 

ob1ecavef:;fn\L'lI;\J"' specifying instructional 

ODjectlves will begin by sampling across types of subject matter tvoes 

LnlT °" '^^"^^^^ °f ^^havior is outlined i^'the 

Resnick proposal on instructional strategy (see Appendix C. pages 5-6) 
Also included will be analyses of types of test itLs needed to assess 
accomplishment of different types of objectives. 

H^.^.^^'^^°'^ '^'"i"^'' ^'^^ Appendix C. page 6) folio;* , covering technical 
N ko r :? rV:i ?P^"^^^^°JJ-tives (Mager. Hively. cLser and 
.ol„?n<, if : ? 'relevance of behavioral specifications to problem 
solving will be explored. Methods of specifying and categorizing objec- 
tives Bloom, Gagne. computer simulation, etc.), methods of analyzing obiec- 

(illJ t^"^'. ^^"f.''^' ^""^ approaches to sequencing objectives 

(Piaget-based. subject-matter structure, information processing, etc.) 
will be studied. With respect to Task 7. the theory of testing will be dealt 
with, giving particular attention to item types and criterio 

begin^w^t^f ^'^^ Appendix C. page 6) occurring next „ill 

rllr. 4 1? ^ ^""J backward to Task 4. The review of various 

whether the'L"::" ^^"^^^^-g/^e domain of the test, and determ^ 
whether the test measures a class of behaviors or a specific set Test 
item types will be examined to identify and compare alternatives for 
J K?,/"^" '^'^"^ °' behaviors. The seminar will deaf with problems 

Cf reliability, validity, and cost/effectiveness, and will consider wJaf 
f:n ^^^^^^^-^^^ -^y. - ^i-g-stic also can be .rlTftZ ^ / 
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The next segment of training on Tasks 4-7 will be a lab in writing 
tests and observational schedules (see Appendix C, pages 7-8). It will 
begin with the trainee being presented with objectives and tests and 
called upon to try, critique, and revise the tests. The next step will 
be to edit the tests without trying them. Finally, trainees will write 
tests, edit each others* products, and revise them. 

A final training segment for Tasks 4-7 will be a lab on analyzing and 
sequencing objectives. This will deal with various types of objectives. 

Associated with the work on testing involved in Tasks 4-7, trainees 
will study the work flow for EVALUATION: Test Development (page 16 above) 
at the core level. The work on tests at the analysis level will be part 
of the lab experiences referred to above. 

The third section of the work flow for curriculum development on 
designing and building the curriculum. Tasks 8-11, is covered directly in 
the Resnick strategy proposal for preparing instructional materials (Appen- 
dix C, pages 5-8). Given the completion of Tasks 5-7 on terminal objectives, 
Task 8 calls for designating a strategy for each type of instructional 
unit prepared in Task 6. These strategy decisions then provide bases for 
preparing instructional materials in Task 9. Testing materials on a few 
subjects and revising these materials on the basis of feedback data (Tasks 
10 and 11) can be done in a laboratory context. 

Instruction in Tasks 12-22 has been dealt with in the opening paragraph 
above on the conduct of Program 2. Task 23 calls for a lab in which trainees 
prepare reports from data provided them. 

Course work in Program 2 will not be confined to work on units that 
have been selected or developed for the university-based program in Instruc- 
tional Development. In addition, under individual advisement, trainees 
will take university courses in general psychology, educational or develop- 
mental psychology, tests and measurement, research design and methods, 
computer science, instructional media, and other areas. Such courses will 
be taken to build essential foundations for training. in curriculum develop- 
ment. 

Outside the work flows more directly related to curriculum development > 
the training program will give systematic attention to developing compe- 
tencies in project management, particularly with prospective Project 
Directors. At a somewhat lower training level, prospective Professional 
Assistants will take labs on aspects of project management that will prepare 
them to assillne leadership responsibilities at least at the sub-project 
level. 
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In Program 2, internships in curriculum development teams at R 5f D 
agencies will be the heart of the second year's work. These will be 
preceded, during the trainee's first year, by observation of curriculum 
development work in R & D agencies and, if possible, by some participation 
in the work of a curriculum team. Such observation or participation is 
a valuable way to learn initially about purposes, procedures, and problems 
of curriculum development as background for seminar and lab work on the 
analysis, editing, and writing of curricular materials. Also, such 
experiences would help prepare the trainee to participate in the selection 
of his internship for the second year. 

To be adequate, an internship in curriculum development should place 
the trainee as a regular working member of a curriculum team where he can 
employ what he has learned in course work and labs covering, insofar as 
possible, the full range of tasks in curriculum building (including tasks 
in related areas of R & D) . Those responsible for selecting and super- 
vising an internship should make every effort to see that the trainee 
is given relevant training experiences. Often it will be important that 
a trainee hold more than one internship position during a year in order 
to extend the range of application of his competencies. 

Course work, seminars, and labs, as well as advisement and counseling, 
will accompany the internship and provide a systematic interaction of 
doing with analyzing and evaluating what one is doing. 

Trainees working for the doctorate in Instructional Development 
will be required to conduct a major original project in curriculum develop- 
ment (or related research) during their third year. Normally the project 
will be conducted in a field or internship setting. This may require 
setting up a special internship setting for the trainee. 



Trainees for Program 2 

It is expected that about 6 trainees will launch Program 2 in Septem- 
ber 1971. The small number is dictated by two considerations: these 
trainees will require major financial support for living and tuition and 
the anticipated funds available will provide for only a few; and the 
requirements of full-time individualized instruction in the program places 
heavy time demands on the instructional staff. 

Trainees will be recruited on a national basis through various forms 
of advertising the program in educational publications, through posters for 
bulletin boards, and by personal contact with college officials, adminis- 
trators of educational agencies including state education departments and 
school systems, and leaders of community organizations concerned with 
educational change. A particular effort will be made to recruit members 
of minority groups. Six agencies in the project Consortium indicated 
the likelihood that one or more persons associated with their organizations 
would probably seek to enroll in Program 2. 
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PROGRAM 3. SHORT-TERM PROGRAM TO TRAIN PROJECT DIRECTORS TO DESIGN 
LOCAL INSTRUCTIONAL CHANGE PROGRAMS 



Purposes and Justification for the Program 

A chief function of utilization specialists assigned to state educa- 
tion departments, intermediate R&D units serving schools, or to R & D 
roles in school systems, is to provide expertise in the design and 
conduct of local innovative programs. An especially frequent expression 
of this function concerns the design of Title I or Title III projects 
and the preparation of project proposals. Another important source of 
leadership in the design of local change programs is provided by educa- 
tional specialists in community organizations. In the past few years, 
educational change in many urban centers has been especially influenced 
by community organizations representing the concerns of minority groups, 
notably Blacks in inner cities. Leaders in these organizations have 
many times assumed the role of designers of local educational change pro- 
grams. The purpose of Program 3 is to provide training to enable leaders 
both within and outside the educational establishment to do a better job 
in the design of local change programs. The program is intended primarily 
for individuals who already hold positions calling for expertness in 
designing innovative programs. 

Particular stress will be placed on the analysis of local needs and 
resources, the generation of alternative approaches to meeting local 
needs, and the selection of an approach that satisfies criteria of rele- 
vance, potency, feasibility, and efficiency. Also, stress will be placed 
on teaching trainees to state project objectives' in operational terms 
and on designing appropriate means for assessing project implementation 
and outcomes. Because of the centrality of school /community relation- 
ships in relation to local educational change. Program 3 will place major 
stress on considering change programs in this context. Trends toward 
decentralization and community control of schools, and toward account- 
ability will receive especial attention. 

Products Intended 

An immediate gain from Program 3 will be improved performance by 
program graduates in their roles as consultants to school systems, leaders 
within school systems, and leaders as community organizations. Also 
tested training components will be developed in this critical area of 
educational R&D. Numerous of these components can be made available 
soon for use in any R&D agency concerned about training of the sort 
offered in the program. Also, these components will become an important 
part of the long-term program to train specialists in the design and 
conduct of local change programs — Program 4. 
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Initiation of the Program 

Program 2 will be initiated with a four- to six-week institute that 
will begin during the summer of 1971. It is expected that trainees can 
most conveniently participate in the program in two-week training blocks. 
This will mean that the institute will be staggered throughout the summer 
and into the fall of 1971. Following the institute, trainees will return 
to the central training location for a one-day training workshop every two 
weeks until the end of the calendar year. 

During 1971-72, Program 3 will be conducted in two sections, one for 
utilization specialists in state education departments, intermediate units, 
and school systems; the other for educational leaders in community organi- 
zations . 



Content of Program 3 

Task areas and tasks to be included in Program 3, and the level of 
training for each, are indicated below. The symbols employed for level 
of training are explained on page 3 of this part of the report. Note that 
the training offered is only at t. ^ Project Director (PD) level since it 
is assumed that the great majority of trainee applicants will hold leader- 
ship positions in respect to designing change programs rather than serving 
as Professional Assistants within teams. 
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LEVEL OF TRAINING 
PD 



UTILIZATION : Local Change Programs 



I. Arrive at program 
obj ectives 



II. Plan the local 
change program 

III* Conduct and assess 
the change program 



IV. Report findings 



1. Specify objectives of program area 

2. Assess present accomplishment of 
objectives. Identify shortcomings 

3. Assess resources available for 
improving accomplishment of 
objectives 

4. List relevant change programs 

5. Assess costs of these change 
programs 

6. Assess local resources, constraints 

7. Rank order potential change programs 

8. Select the change program 

9. Design the change program 

10. Design program to assess change prog. 

11. Obtain the required resources 

12. Conduct pre-implementation activities 

13. Implement the change program 

14. Analyze, interpret feedback data 

15. Revise program, implement again 

16. Prepare report on program effective 
ness with recommendations for use 



CI 



DEVELOPMENT: Curriculum or Training Programs 



I. Arrive at general 
program objectives 



II. Specify instructional 
objectives 



III A Design and build 
the program 



1. Identify need for program 

2. Judge importance, feasibility 

3. Iden.'.ify classes of objectives 



A. Specify 2rminal objectives 

5. Analyze terminal objectives 

6. Get up sequences, units 

7. Make tests, observational schedules 



CI 



8. Formulate instructional strategies 

9. Prepare instructional materials 

10. Test materials on a few subjects 

11. Interpret test data, revise 
materials J 



ERIC 
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LEVEL OF TRAINING 
PD 



DEVELOPMENT : Instructional Environment Systems 



I. Arrive at objectives 
for program 



II • Develop strategy for 
building the system 



1. Identify need for program 

2* Judge importance, feasibility 

3# Identify purposes to be served 

A. Specify objectives of the environment 

5. Specify features of required 
environment 

6. Specify ways to Incorporate features 

7. Analyze the alternative ways 

8. Select an alternative 



CI 



III. Build the system 



9. Determine resources required 
10. Develop the system 



DIFFUSION: Field Testing 

I. Arrive at general 
program objectives 



II. Specify required 
product adaptations 

III. Prepare to conduct 
the field test 



1. Select and describe field test 
product 

2. Specify purposes of field test 

3. Identify sub-populations of users 

4. Identify needed modifications 

5. Design needed product modifications 

6. Great and test the modifications 

7. Design changes in implementing product 

8. Develop and test these changes 

9. Develop assessment program for 
product implementation and outcomes 



C2 



J 



DIFFUSION: Demonstrr.tion 

I. Arrive at general 
program objectives 



II. Plan for types of 
demonstration 

JII. Design plan for 
demonstration 



1. Select, describe product to 
demonstrate 

2. Specify purposes of the demonstration 

3. Identify sub-populations for demons tr. 

4. Specify criteria and select sites 

5. Design plan f'^r implementing demonstr. 

6. Design plan to assess demonstration 



^ 



>C1 
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DIFFUSION: Dissemination 

I» Arrive at program 
objectives • 



1. Identify dissemination need 

2. Judge Importance, feasibility 

3. Specify dissemination objectives 



II. Plan the dissemination 4.' Identify • target population 

program 5. Formulate disseminatiun strategy 



1 
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EVALUATION 
A, Formative 

I. Context evaluation 



II. Input evaluation 

III, Process evaluation 

IV. Product evaluation 

B. Summatlve 

I* Arrive at purposes 
of the evaluation 

II* Develop evaluation 
plan 



1. Identify present goals of system 

2« Assess value of goals 

3. Plan for assessing goal achievement 

A. Assess current goal achievement 

5. Identify problem area 

6. Identify goals of development effort 

7. Evaluate the development goals 

8. Specify how to assess goal attainment 

9. Evaluate plans for achieving goals 

10. Assess program implementation 

11. Monitor program structuring 

12. Further monitor program Implementation 

13. Assess degree of attainment of goals 

14. Prepare evaluation reports 



1. Specify characteristics to evaluate 

2. Specify purposes of evaluation effort 

3. Identify dimensions to be evaluated 

A. Identify data collection means 

5. Analyze and compare the alternatives 

6. Select data collection approach 

7. Develop procedures for data analysis 

8. Evaluate constraints re procedures 

9. Modify procedures re Step 8 

10. Plan evaluation study activities 
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LEVEL OF TRAINING 
PD 



EDUCATIONAL R&D FOUNDATIONS 



1. Define and relate educational development, diffusion, C2 
utilization, evaluation, and research 

2. Describe functions, programs, and roles of types of C2 
educational R&D agencies 

3. Demonstrate competence In search skills In locating PI 
educational R&D information 

4* Describe the features of the educational reform C2 
movement In the U.S. since 1955 

5. Describe Instructional systems In terms of their major C2 
components 

6. Compare or contrast two or more Instructional systems A 
in terms of how their components are represented 

7. Specify the requirements for building a programed C2 
instructional unit 

8. Specify the requirements for Instructional programs C2 
representing Individualization, mastery, and 

student self-direction 

9. Compare and contrast instructional systems ln»terms A 
of the degree to which they involve Individualization, 

mastery, and student self-direction 

10. Specify the Instructional requirements for teaching C2 
inquiry 

11. Compare and contrast curricula and Instructional A 
approaches In terms of the extent to which they are 

appropriate for teaching Inquiry 

12. Describe school /community relationships In terms of 
their Impact on instructional programs 

13. State various types of learning objectives in terms 
of student behaviors 
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SOCIAL/PERSONAL COMPETENCIES 
A. Interpersonal 

1. Inform co-workers effectively 

2. Request needed information, help from co-workers 

3. Assist co-workers and accept their assistant e 
A. Contribute ideas to group planning 

5. Assess one^s competencies in contributing to group 
&• Accept, perform different roles in group 

7. Contribute to work flow of the group 

8. Evaluate group performance, suggest improveir.f:nts 

9. Contribute to positive interaction of group members 



LEVLL OF TRAINING 
PD 



> 



B. Work Habits/Attitudes 

10. Perform and complete work on schedule 

11. Accept and assume responsibility for work 

12. W>rk independently 

13. Subordinate personal interests to work requirements 

14. Maintain professional ethics in work activities 

15. Show interest in work as by improving competencies, 
participating in professional organizations 
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LEVEL OF TRAINING 
PD 



PROJECT MANAGEMENT 
I. Plan the project 



1. State objectives as productst 
processes 

2. Select a planning technique 

3. Diagram activities flow 

A. Estimate staff » funds, time, etc. 
needs 

5. Define staff roles and organization 

6. Plan needed external Interactions 

7. Prepare project plans w. deadlines 

8. Establish planning feedback mechanism 

9. Periodically assess plan effectiveness 
10. Revise plan or components as needed 



02 



J 



III. Build manpower 
resources 



IV. Supervise project 



18. Recruit and select staff 

19. Orient staff to the project 

20. Assess staff training needs 

21. Select, design training experiences 

22. Conduct staff training 

23. Build working relations with 
other project/agencies 

24. Make assignments 

25. Delegate authority 

26. Maintain quality/efficiency standards 

27. Parcel work to other project/agencies 

28. Adjust excessive/insufficient work 
loads 

29. Provide appropriate reinforcement 

30. Maintain accounwabllity mechanism 



CI 



CI 
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Conduct Program 3 

The general sequence of training components is given below, 
beginning with the institute and continuing with bi-weekly training 
days. The outline presented here obviously is tentative; numerous 
changes can be expected when the program materials and procedures are 
developed during the early months of the operational phase. 



TRAINING INSTITUTE 



Weeks 
(approx. ) 



R&D Foundations, Tasks 1-5, 12 
Work Flows in Development, Diffu- 
sion#Analysis of designs for local 
change programs. 

R&D Foundations, Tasks 6-11, 12, 13 
Editing designs of local change 
programs 

Work Flows in Formative & Summative 

Evaluation 
Designing local change programs, given 

simulated data 

Work Flow in Utilization, Tasks 11-16 
Work Flow in Project Mgmt«, Tasks 1-10, 
18-30 

Strategies for working with school 
people in designing local change 
programs 



Level of 
Training 

C2 
C1,C2 
A 



C2,A 
PI 



C2,A 
P2,T 



CI 
C1,C2 



Media 

Pl/Rdg./Sem. 
Pl/Rdg./Sem. 
Sem./Lab Sim.* 



Pl/Rdg./Sem. 
Sem./Lab Sim. 



PI/Rdg./Sem. 
Sem./Lab Sim. 



PI/Rdg./Sem. 
PI/Rdg./Sem. 

/Lab Sim. 



* Laboratory simulation 



Bi-Weekly Training Workshops . Following the completion of the insti- 
tute, trainees will attend a one-day workshop every two weeks for two and 
one-half months, a totrl of five additional training days. These workshops 
will serve to integrate training obtained in the institute with job per- 
formance through study of case data derived from trainees* work in the 
design of local change programs. Also, new training units will be added 
in areas revealed to require special attention. 



- 34 - 



Trainees for Program 3 

Two groups of trainees will be conducted through Program 3 during 
the initial implementation of the program, beginning in the summer of 
1971. One group of 12-15 trainees will consist of R & D personnel 
currently employed by the Pennsylvania State Department of Education, 
by intermediate educational units serving school systems, and by school 
systems. These will be specialists having responsibilities for designing 
(and conducting) local change programs. Between 20 and 30 such trainees 
have been estimated to be available within Consortium agencies. Thus 
it will be possible to launch Program 3 with trainees drawn entirely 
from the Consortium; major advantages of this are geographical access 
to these trainees and financial support from their employers. 

The second group consists of educational leaders of community 
organizations who have major roles in influencing the choice and design 
of local educational change programs. Organizations in Pittsburgh that 
are interesting in providing trainees for Program 3 are Pittsburgh Model 
Cities, the Urban League, Forever Action Together (a Black community 
service organization), and the Bidwell Cultural and Training Center. It 
is anticipated that 8-10 trainees will come from such community organiza- 
tions . 
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PROGRAM 4. LONG-TERM PROGRAM TO TRAIN PROJECT DIRECTORS AND PROFESSIONAL 
ASSISTANTS TO DESIGN AND CONDUCT LOCAL CHANGE PROGRAMS 



Purposes and Justification for the Program 

This program is designed to provide systematic training for persons 
who will have key roles in the design and conduct of local instructional 
change programs. The program will offer two or three years of full-time 
training leading to the masters or doctoral degree, or to equivalent 
certification. The aim is to provide the trainee with a professional 
basis for making key decisions about ^hat changes are needed in local 
instructional programs and what approaches to meeting those needs are 
likely to provide effective and feasible. Also the program will develop 
expertise in designing, implementing, and assessing change programs of 
different types and conducted in different contexts. Stress will be placed 
on designing and conducting change programs that are relevant to critical 
educational problems involving educationally disadvantaged groups. Trainees 
will learn to give attention to various types of learning goals (tool 
skills in language and mathematics, competencies in self-directed learning, 
inquiry or problem-solving skills, and personal/social attitudes and 
behavior). Also they will learn to build into local change programs 
provisions for the use of instructional approaches and media that are 
suitable for individualized instruction. 

Justification for this program is found in the fact that thousands of 
persons lacking specific training for their work now are employed in 
positions calling upon them to take leadership in the design or conduct 
of local instructional change programs. Each year thousands more enter 
positions where they are called upon to assume similar roles. The posi- 
tions referred to include specialists in state education departments, 
intermediate units, school systems, and community-action organizations, 
as well as consultants from universities or private firms. Virtually 
every school system in the country each year undertakes some form of 
change program. Title I and Title III projects offer one nearly-universal 
occasion for developing change programs. Program 4 will offer training 
for any positions that involve taking part as Project Director (or consul- 
tant) or Professional Assistant in designing, conducting, and assessing 
any form of change program. 

Special contributions of Program 2 to the upgrading of local change 
efforts will result from its emphases on training to identify needs for 
change that take specific account of school/community factors, to consider 
various types of learning goals, and to seek to meet the special needs of 
minority groups. The program will offer training to identify and compare 
alternative approaches to meeting the needs that have been identified* 



Products Intended 



It is intended that the development of Program 4 during the opera- 
tional phase will provide a tested design for training experts in 
planning and conducting local change programs of various types • Also 
the program will provide trainirg procedures and materials that can be 
employed in various pre~service and in-service settings • Only a small 
number of trainees can be accommodated in this program during the 
operational phase. This number could be significantly increased with 
the same funding once the program and materials development activities 
taper off, allowing an increased proportion of funds to go for training. 

Initiation of Program 4 

It is planned to introduce Program 4 in the fall trimester of 
1911-11 at the University of Pittsburgh. The initial group of students, 
recruited on a national basis, probably will consist chiefly of graduate 
students enrolling for the two-year, masters level, course of training. 
A few may be expected to enroll for the three-year, doctoral-level, program. 
During the first year, 1971-72, all trainees will engage mainly in course 
work and laboratory activities, with internship experiences provided 
during the second and third years. To tie the program in with real 
problems in real situations, an emphasis on field observation will be built 
into the program from its inception. 



Content of Program 4 

A listing of task areas and tasks from the List of Tasks in Educa- 
tional R&D (Appendix A) that will be covered in Program 4 follows. For 
each task area or task, the level at which it is to be mastered is indicated 
Note that provisions are made for training both Project Directors (PD) 
and Professional Assistants (PA). It will be seen that, with many tasks, 
both categories of trainees will be called upon to achieve mastery at the 
same level. It is assumed that training for Professional Assistants should 
differ from that for Project Directors mainly in its length, in the amount 
of training in project management, and in whether or not the trainee is 
to conduct a major original project as a requirement for the doctorate. 

The reader is reminded that the symbols for Level of Training are 
explained on page 3 above. 
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LEVEL OF TRAINING 
PD PA 



UTILIZATION : Local Change Programs 



I. Arrive at program 
objectives 



II. Plan the local 
change program 

III. Conduct and assess 
the change program 



1. Specify objectives of program area 

2. Assess present accomplishment of 
objectives, identify shortcomings 

3. Assess resources available for 
improving accomplishment of 
objectives ^ t-J 

4. List relevant change programs 
3« Assess costs of these change 

programs 

6« Assess local resources, constraints 

7. Rank order potential change programs 

8. Select the change program 

9. Design the change program \ 

10. Design program to assess change prog.f 

11. Obtain the required resources ] 

12. Conduct pre-implementation activities j 

13. Implement the change program ^ 

14. Analyze, interpret feedback data 

15. Rcivise program, implement again 



T-J 



P2-J 



T-J 



P2-J 



PI- J 



IV. Report findings 



16. Prepare report on program effective- p2 p2 
ness with recommendations for use 
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LEVEL OF TRAINING 
PD PA 



DEVELOPMENT: Curriculmn or Training Programs 



I. Arrive at general 
program objectives 



II. Specify instructional 
objectives 



III A Design and build 
the program 



IV. Build instructional 
environment 



V. aild teacher/staff 
training program 

VI. Pilot test the 
program; revise, 
re test 



VII. Report findings 



1. Identify need for program 

2. Judge importance, feasibility 

3. Identify classes of objectives 

A. Specify terminal objectives 

5. Analyze terminal objectives 

6. Set up sequences, units 

7. Make tests, observational schedules 



8. Formulate instructional strategies 

9. Prepare instructional materials 

10. Test materials on a few subjects 

11. Interpret test data, revise 
materials ^ 



C2 



12. Design needed instructional 
environment 

13. Prepare materials for environment 

14. Identify teacher/staff behaviors 

15. Prepare training materials 

16. Design pilot test of program 

17. Conduct pilot test 

18. Analyze, interpret feedback data 

19. Revise curriculum/training program 

20. Revise instructional environment 

21. Revise training program 

22. Retest revised program on pilot 
basis 

23. Prepare report on the program 



> C2 



C2 



CI 



erJc 



I 



- 39 - 



LEVEL OF TRAINING 
PD PA 



DEVELOPMENT: Instructional Environment Systems 



I 



I. Arrive at objectives 
for program 



II. Develop strategy for 
building the system 



III. Build the system 

IV. Provide curriculum 
to implement system 

V. Provide training 
program for teachers 

VI. Pilot test the system; 
revise, retest 



VII. Report findings 



1. Identify need for program 

2. Judge importance, feasibility 

3. Identify purposes to be served 

4. Specify objectives of the environment 

5. Specify features of required 
environment 

6. Specify ways to incorporate features 

7. Analyze the alternative ways 

8. Select an alternative 



> A 



C2 



9. Determine resources required 

10. Develop the system 

11. Identify curriculum needs 

12. Build the curriculum 

13. Identify teacher behaviors 

14. Build teacher education program 

15. Design the pilot test 

16. Conduct the pilot test 

17. Analyze and interpret feedback data 

18. Revise environment system 

19. Revise curriculum for system 

20. Revise training program for system 

21. Retest system on pilot basis 

22. Prepare report on the system 



CI 



CI 



ERIC 
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LEVEL OF TRAINING 
PD PA 



DIFFUS ION : Field Testing 

I. Arrive at general 
program objectives 



II. Specify required 
product adaptations 

III. Prepare to conduct 
the field test 



IV. Conduct and assess 
the field test 



V. Prepare a report 



1. Select and describe field test 
product 

2. Specify purposes of field test 

3. Identify sub-populations of users 

4. Identify needed modifications 

5. Design needed product modifications 

6. Great and test the modifications 

7. Design changes in implementing product 

8. Develop and test these changes 

9. Develop assessment program for 
product implementation and outcomes 

10. Select settings for the field test 

11. Secure cooperation from test sites 

12. Select, train field testers 
13» Conduct the field test 

14. Revise program or its implementation 

15. Repeat the field test 

16. Analyze and report data on field test, 
recommending changes to developer or 
producer 



C2 



f 



DIFFUSION: Demonstration 



erJc 



I. 


Arrive at general 


1. 




program objectives 








2. 


II. 


Plan for types of 


3. 




demonstration 


A. 


III. 


Design plan for 


5. 




demonstration 


6. 


IV. 


Prepare for and 


7. 




conduct demonstration 


8. 






9. 






10. 






11. 






12. 


V. 


Prepare a report 


13. 



demonstrate 



J M^^^y ^-M^w^*. VI^1IIV/I1«9 urn O 1. JLV/I 

recommending product modifications to 
developer or producer 



C2 
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LEVEL OF TRAILING 
PD FA 



DIFFUSION: Dissemination 

I. Arrive at program 
obj ectives 



II, Plan the dissemiuc^tion 
program 

III, Build and test the 

dissemination materials 



IV. Conduct and assess 
the dissemination 
progrii.iv 



V, Report findings 



1. Identify dissemination need 

2. Judge importance, feasibility 

3. Specify dissemination objectives 

4. Identify target population 

5. Formulate dissemination strategy 

6. Develop dissemination materials 

7. Develop evaluation instruments 

8. Pretest prototype materials 

9. Revise materials 

10. Implement the dissemination 
program 

11. Assess program effectiveness 

12. Revise the program, repeating 
steps 10 and 11, 

13. Prepare a report of findings, 
with recommendations to 
producers and marketers of 
the product 



> 



C2 



ERIC 



EVALUATION 
A. Formative 

I. Context evaluation 



11 • Input evaluation 

111. Process evaluation 

IV. Product evaluation 

B. Summatlve 

1. Airlve at purposes 
of the evaluation 

11. Develop evaluation 
plan 



111. Conduct the 
evaluation 

IV. Report findings 

C. Test Development 

1. Arrive at purposes 
of the test 

11. Plan the test 

111. Build the test 
IV. Try the test 

V. Analyze data and 
revise test 

VI. Report findings 
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LEVEL OF TRAINING 
PD PA 

1. Identify present goals of system 

2. Assess value of goals 

3. Plan for assessing goal achievement 

4. Assess current goal achievement 

5. Identify problem area 

6. Identify goals of development effort 

7. Evaluate the development goals ^ \ A 

8. Specify how to assess goal attainment | 

9. Evaluate plans for achieving goals 

10. Assess program Implementation 

11. Monitor program structuring 

12. Further monitor program Implementation 

13. Assess degree of attainment of goals 

14. Prepare evaluation reports 



1. Specify characteristics to evaluate 

2. Specify purposes of evaluation effort 

3. Identify dimensions to be evaluated 

4. Identify data collection means 

5. Analyze and compare the alternatives 

6. Select data collection approach 

7. Develop procedures for data analysis 

8. Evaluate constraints re procedures 

9. Modify procedures jre Step 8 

10. Plan evaluation study activities 

11. Conduct pre-study activities 

12. Conduct evaluation data collection 

13. Analyze data 

14. Interpret findings 

15. ' Prepare a report with recommendations 



A 



1. Define purposes and uses of the test 

2. Prepare content » behavioral specs. 

3. Survey limits for use, administration 

4. Develop scoring procedures 

5. Determine test length 

6. Plan Item construction 

7. Develop Items, directions 

8. Plan ttyout stages 

9. Tryout the test (alternate forms) 

10. Analyze data from tryout 

11. Recycle If data calls for It 

12. Prepare final version of test 

13. Prepare technical report, test manual 



ERIC 



I 
I 
I 



I 



\ 



RESEARCH 



I. Formulate research 
hypothesis 



!!• Design ihe 
research plan 



III. Conduct the 
study 



IV. Analyze data and 
prepare report 
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LEVEL OF TRAINING 
PD PA 



1. Select the topic and variables 

2. Review previous related theory 
and research 

3. Identify situational factors 
that limit the approach 

4. Specify problem re variables 

5. Predict variable relationships 

6. Plan the research approach 

7. Assess feasibility of plan 

8. Define variables re operations 
and measures 

9. Identify subject population 

10. Specify the research design 

11. Modify design to constraints 

12. Plan to implement the design 

13. Conduct pre-research activities 
a* train personnel 

b. confirm validity of procedures 

c. conduct liaison/logistics 
d« revise design as needed 

14. Implement research plan 

15. Monitor operations for problems 

16. Change design to overcome 
difficulties 

17. Complete data collection 

18. Transfer data to appropriate 
form for analysis 

19. Implement statistical analysis 

20. Depict findings with graphs, etc. 

21. Summarize, interpret and report 
findings 



> A 



ERiC 



- 44 - 



ERIC 



EDUCATIONAL R&D FOUNDATIONS 



2. Describe functions, programs, and roles of cypes of 
educational R&D ager^les 



15. Demonstrate knowledge of the relationships of 
basic and applied research to Instruction 



LEVEL OF TRAINING 
PD PA 



1. Define and relate educational development, diffusion, C2 C2 

utilization, evaluation, and research 



C2 C2 



3. Demonstrate competence In search skills In locating Pi Pi 
educational R&D Information 

4. Describe the features of the educational reform q2 C2 
movement In the U.S. since 1955 

5. Describe Instructional systems In terms of their major C2 C2 
components 

6. Compare or contrast two or more Instructional systems ^ ^ 
In terms of how their components are represented 

7. Specify the requirements for building a programed C2 C2 
Instructional unit 

8. Specify the requirements for Instructional programs C2 C2 
representing Individualization, mastery, and 

student self-dlrectlon 

A A 

9. Compare and contrast Instructional systems ln»terms 

of the degree to which they Involve Indlvluuallzatlon, 
mastery, and student self-dlrectlon 

10. Specify the Instructional requirements for teaching 
Inquiry 

11. Compare and contrast curricula and Instructional ^ ^ 
approaches In terms of the extent to which they are 

appropriate for teaching Inquiry 

12. Describe school/community relationships In terms of A A 
their Impact on Instructional programs 

13. State various types of learning objectives In terms p2 P2 
of student behaviors 

14. Demonstrate knowledge of learning theory re concepts, 
principles, discrimination, transfer, motivation, 
and reinforcement In relation to Instruction. 



C2 C2 
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social/personal competencies 

A, Interpersonal 

1, Inform co-workers effectively 

2, Request needed information, help from co-workers 

3, Assist co-workers and accept their assistante 
A» Contribute ideas to group planning 

5, Assess one^s competencies in contributing to group 

6, Accept, perform different roles in group 

7, Contribute to work flow of the group 

8, Evaluate group performance, suggest improvements 

9, Contribute to positive interaction of group members 



LEVEL OF TRAINING 
PD PA 



> J 



B, Work Habits/Attitudes 

10, Perform and complete work on schedule 

11, Accept and assume responsibility for work 

12, W)rk independently 

13, Subordinate personal interests to work requirements 

14, Maintain professional ethics in work activities 

15, Show interest in work as by improving competencies, 
participating in professional organizations 



ERIC 
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II* Build budgets 
and contracts 



II I • Build manpower 
resources 



IV • Supervise project 



V. Communicate 
Information 



LEVEL OF TRAINING 
PD PA 



PROJECT MANAGEMENT 

I. Plan the project 1. 

2. 
3. 
4. 

5. 
6. 
7. 
8. 
9. 
10. 



State objectives as productSt 
processes 

Select a planning technique 
Diagram activities flow 
Estimate staff, funds, time, etc. 
needs 

Define staff roles and organization 
Plan needed external Interactions 
Prepare project plans w. deadlines 
Establish planning feedback mechanism 
Periodically assess plan effectiveness 
Revise plan or components as needed 



> P2-J Pl-J 



11. Identify funding sources 

12. Estimate project costs 

13. Analyze organization/funding for 
compliance to relevant guidelines 

14. Prepare detailed budget 

15. Select a cost control system 

16. Prepare formal contracts 

17. Procure facilities; equipment 



> P2 



Pi 



18. Recruit and select staff 

19. Orient staff to the project 
Assess staff training needs 
Select, design training experiences 
Conduct staff training 
Build working relations with 
other project/agencies 



20. 
21. 
22. 
23. 



P2 



PI 



24. Make assignments 

25. Delegate authority 

26. Maintain quality/efficiency standards 

27. Parcel work to other project/agencies 

28. Adjust excessive/Insufficient work 
loads 

29. Provide appropriate reinforcement 

30. Maintain accountability mechanism 



> 



Pi-J 



PI 



31. 

32. 

33. 
34. 



Develop communication network within 
agency 

Periodically report progress to 

admlnlstrators/funders 

Explain decisions to staff 

Develop liaison with Interested groups » 

Individuals 



> PI 



PI 



ERLC 
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Conduct of Program A 

The central part of Program 4 is found in the work flow for UTILIZATION: 
Local Change Prograns (page 37). Program 3, it will be recalled, focused on 
Tasks 1-10 of this work flow since trainees in that program will not be 
taught to conduct change programs. Program 4, on the other hand, offers 
training that proceeds beyond designing change programs to include intensive 
work on conducting, assessing, and reporting findings of change programs 
of various types. 

In reviewing the task coverage in Program 4, it should be noted that 
all tasks in all work flovjs in the List of Tasks in Educatational R&D are 
included in the training program, at least at the core (CI or C2) level . 
Many of the tasks are to be studied at the higher analysis (A) level as is 
the case with the work flows in Evaluation. Other tasks carry the trainee 
to the PI, P2, or T level and call for further training at the job (J) level. 

During 1971-72, the first year of training. Program 4 will be conducted 
almost entirely through course work, field observation and participation, 
and laboratory activities. The details on how this work will be conducted 
can only be sketched in broad outline at this time since those details must 
be worked out during the period of intensive program development and materials 
development that will be launched in February 1971, if the project is funded. 

The first major objectives of Program 4 concern Tasks 1-3 in the work 
flow for UTILIZATION: Local Change Programs . These cover arriving at needs 
for change programs and assessing resources available locally and elsewhere 
for meeting those needs. In this initial part of the training program, 
intensive work in Educational R&D Foundations (see page AA) will be offered 
with stress particularly on Tasks 1-6 and 12. Also there will be systematic 
field observation to learn about school/community relationships and the conduct 
of instructional programs of different types at different age levels (preschool, 
elementary, and secondary). In addition, the initial part of the training 
program will introduce the trainees to the work flows for Development and 
Diffusion at the core level. 

The second segment of the training program will focus in Tnsks A-8 of 
the work flow for UTILIZATION: Local Change Programs > The emphasis in this 
part of the program will be on laboratory activities in which the trainee 
analyzes, evaluates, and edits designs of local change programs in terms of 
their relevance for meeting designated needs and in terms of their theoretical 
and practical aspects. Further work in Educational R&D Foundations will be 
offered here involving Tasks 8--1'' on individualization and inquiry, and Task 14 
on learning theory (see page 44). Also, during this period of training work 
in Formative Evaluation will be introduced (see page 42) . 

In the third major segment of the first year's work, the trainee will 
learn to design change programs of various types. This covers Tasks 9 and 
10 of the task flow for UTILIZATION: Local Change Programs . At this time, 
core work in the work flow for PROJECT MANAGEMENT will be introduced (see 
page 46). Work in Summative Evaluation and Test Development will be offered 
here. 
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The fourth major part of the year's work will cover tasks 11-16 of 
the work flow for UTILIZATION: Local Change Programs that are concerned 
with implementing and testing change programs. Since trainees will not 
be able to proceed through these tasks in the real world at that time, 
the training materials will focus in laboratory simulation. An emphasis 
in the work of this part of the program will be on tasks in Project 
Management, especially for trainees at the Project Director level. An 
introduction to the work flow for Research (see page 43) will be included 
at this time. This section of the program also will stress matters involving 
working with people in schools and communties as related to conducting 
evaluating, and reporting change programs. 

Trainees in Program 4 will, under advisement, take university course 
work outside that offered in Instructional Development. Such courses may 
be in sociology, cultural antrhopology, general psychology, educational 
psychology, child development, tests and measurement, research methods, 
instructional media, and other areas. These courses will be selected in 
terms of their value as foundational to work on local change programs 
and in terms of matching the individual needs and interest of the trainee. 

In Program 4, internships for the second or third year must be in 
educational R&D agencies where the trainee can gain experience in 
applying the training he received during his first year to a variety 
of kinds of change programs involving different populations, different 
aspects of the instructional program, and different modes of intervention 
to accomplish the desired changes. Ideally, the trainee will have more 
than one internship setting. The problem of obtaining adequate super- 
vision may prove important. A solution to this problem probably can be 
found by placing some trainees in R & D contexts focused on diffusing 
instructional innovations since there is a marked overlap of tasks in 
the diffusion and the utilization work flows. Within the Consortium, 
Research for Better Schools and the Learning Research and Development 
Center both can offer good internships in their diffusi^>n tAsk force?. 
Of course supervised internships can be provided trainees in Program 4 
in the school systems at Philadelphia and Pittsburgh, and the Pennsylvania 
State Department of Public Education. 

During their third training year, candidates for the doctorate will be 
required to conduct a major project involving local change programs. 
Normally this project will be conducted in a field setting, perhaps as 
part of an internship. 

Trainee for Program 4 

It is expected that about 6 trainees will begin work in Program 4 in 
September 1971. The small number, as with Program 2, is dictated by a shortage 
of funds to provide the heavy financial support required, and by the 
shortage of project personnel to j;ive the extensive individualized atten- 
tion each trainee will require. 

Trainees will be recruited on a national basis . A particular effort 
will be made to recruit members of minority groups and leaders of local 
community-action organizations. Five agencies in the project Consortium 
have indicated that they are likely to provide one or more trainees for 
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Program 4. It is likely that school systems, once they learn about Program 4, 
will want to send key personnel responsible for local innovative changes to 
Program 4. Often, however, the lack of funds will require school systems 
to turn to the less costly Program 3. 

General Plan for Individualizing the Training Programs 

A central purpose of the training programs is that of individualizing 
the conduct of instruction. The features of an individualized program have * 
been stated earlier in Part I of this report (page 3). Essentially, an 
"educational guidance" approach is what is called for. Such an approach 
requires thac each trainee's inputs be assessed to determine the extent 
to which he already has achieved program objectives as well as his charac- 
teristics as a learner that will determine his most effective routes toward 
achieving program objectives. 

Individualized guidance begins with the recruitment and selection 
process. Once a prospective trainee has expressed interest in enrolling 
in a training program, the process of individualization begins. Admission 
to a program as well as initial program planning should be viewed as a 
contract between program advisors and the new trainee. 

Conducting training on an individualized baf5is requires that both 
the trainee's long-term program and his short-term assignments be spec- 
ifically designed for him on the bases of pre-test information and diag- 
noses of his learner characteristics. The learning tasks assigned him 
must take account of his entering behaviors wich respect to those tasks 
and must provide appropriate learning materials and instruction. Previsions 
should be made whereby the trainee can take the time he needs to master 
the assigned tasks, then move on immediately to further tasks. This 
requires that instruments and procedures be available to assess the 
trainee's work, task-by-task. 

The individualized approach listed above requires that each trainee 
have an adviset who is chiefly responsible for his total program and who 
maintains close \r?orking relations with the trainee's instructors in order 
to maintain the unity and direction of his program. It requires also that 
each member of the instructional staff understand and accept the principles 
and procedures of individualized instruction. 

A key aspect of individualization in the training programs concerns 
internship placement. It is vital that each trainee hold an internship 
that is well-suited to his training needs. To bring this about, often 
it will be necessary to shape internships to fit a trainee's requirements. 
This may be done sometimes by moving a trainee into a different internship 
setting within an agency. Also, individualizing the internship requires 
regular supervision, and advisement or instruction directed toward remedying 
deficiencies . 

Graduation from a training program with credits, a degree, or a cer- 
tificate will depcind upon demonstrated mastery of program requirements, 
including evidence of possessing the requisite personal/social competencies. 
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Job placement obviously is an individualized matter. For it to be 
effective, the project staff will need to possess extensive information 
about jobs available not only locally but nationally. 

To obtain evidence on the success of the training program, and 
feedback information for improving it, as well as bases for aiding 
the program graduate, systematic follow-up of graduates will be 
conducted. 

The above constitutes a set of general requirements for individ- 
ualization that must be met in the training programs. Working out 
detailed procedures for accomplishing these purposes is a central task 
of the initial months of the operational phase. 



General Plan for Implementing the Traininf^ Programs 

A key aspect of program development during the early months of the 
operational phase will be working out detailed procedures for implementing 
the training programs. The requirements for developing and utilizing the 
essential implementation procedures are indicated in the section of Scope 
of Work on program development. 

Planning to implement the programs requires, first of all, the 
establishment of the requisite instructional programs within the University 
of Pittsburgh. Designing, initiating, and staffing the new program in 
Instructional Development within the School of Education is a critical 
task. Providing procedures, arrangements, and schedules for conducting 
instruction utilizing university staff members and others is important. 
Orienting and training the instructional staff to conduct instruction in terms 
of the purposes and procedures of the training programs likewise is essential. 

Arrangements must be worked out with Consortium members and others 
whereby trainees are recruited, selected, and admitted with the active 
participation of their sponsors. This will be necessary often because 
support for trainees must come from sources other than the grant funds. 

The roles that project staff members are to play in implementing 
the training programs must be clarified. Most staff members will wear 
two or three hats~as regular members of the LRDC staff, as professors 
at the University of Pittsburgh, and as members of the project staff. 

General Plan for Evaluation of tiie T raining Prop.rams 

Each of the proposed training programs described in this doctonent 
includes an outline of steps in the formative and summative evaluation 
process which will be included in the competencies which the trainee will 
be expected to master. These same steps have been, and will be, used in 
carrying out the evaluation of these training programs, both while they 
arc being developed (formative evaluation) and in the final assessment 
of their effectiveness (summative evaluation). 
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An early step in the formative evaluation of a program development 
effort must be the identification of the goals of the program and an 
assessment of their potential value in meeting targeted needs. As this 
document indicates, much work has already been done on this step. The 
goals of each program have been specified in terms of "purposes" and 
"products intended." These goals have been assessed through a process 
of review by all members of the consortium. Further evaluation will take 
place as the development effort is pursued and they can be examined in 
terms of their possibility of attainment. 

Another key step in formative evaluation is the assessment of the 
specific plans for achieving program goals. Detailed specification of 
these plans will be carried out in the next ph-^se of program development 
and the evaluation of these plans will take place at that time. This 
evaluation will include an assessment of their potential for achieving 
the goals, their feasibility for actual implementation, and their clarity 
and specificity. This part of the evaluation effort will he aided greatly 
by the fact that this proposal specifies the content of each prr{^,ram in 
terms of the steps that the trainee is to be able to carry out, that is, 
the specific behaviors he is to acquire. 

Perhaps the major component of the formative evaluation effort will 
be the careful monitoring of the implementation of the planned programs. 
Here evidence will be obtained concerning the extent to which the oper- 
ating program resembles the planned program and the extent to which certain 
aspects of the plan have to be modified. This step in evaluation will 
involve feedback from instructors and trainees as well as observation by 
program supervisors and designated evaluators. Eventually, it will also 
include data on student performance and achievement. Most of the specifics 
concerning this phase of evaluation will be planned in the coming months 
of further development of the program. 

Obviously, a final summative evaluation of any of the programs outlined 
in this document must await feer^^nck concerning the eventual on-the-job 
performance of trainees who complete the program. However, the fact that 
most trainees will take part in some type of practicum or internship will 
provide some opportunity for an interim summative evaluation by studying 
the relevance of thier more formal training to this type of in-service 
performance. This feedback can come from both the trainee and the intern 
supervisor. Plans for later follow-up of graduates are also being formulated. 

As with all aspects of the proposed training programs, the evaluation 
activities will be planned in detail during the next phase of development. 
However, certain types of evaluation are already underway. Also, program 
outlines and descriptions as presently formulated have been specified in 
such a way as to enhance possibilities for meaningful evaluation in subse- 
quent steps. In all current and future evaluation activities, the consor- 
tium will be able to make use of the services of members who have had con- 
siderable experience in evaluation activities. (See, for example, CM. Lindvall 
and Richard C. Cox, Evaluation As a Tool in Curriculum Development : The IPI 
Evaluation Program , AERA Monograph Series on Curriculum Evaluation, Chicago, 
Rand McNally, 1970) 
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RATIONALE AND DESCRIPTION OF THE PROJECT CONSORTIUM 



The Project Consortium for the Design Phase 

An effective and broadly representative consortium of agencies has beer> 
a major achievement of the design phase of this project. Members were drawn 
from a wide range of agencies actively pursuing educational innovation; a 
program generating highly-trained personnel is central to the long-term 
plans of each member. This shared goal facilitated the coordination of 
different perspectives on educational change and focused the efforts of all 
members on the goals of the design project. With this unified purpose, the 
Consortium produced three important things: a model of educational change 
basic to training programs, the design of training programs to be developed 
and tested during the operational phase, and a preliminary model of a training 
consortium suited for developing, implementing, and testing the training programs. 

The training programs presented in this report are in the strictest sense 
the product of the Consortium rather than of any individual agency. To accom- 
plish its work, the Consortium operated on two levels. First, the entire 
Consortium held half-day working meetings monthly to provide a forum for 
discussion and assessment of progress. Topics to which the discussions were 
directed progressed throughout the project. Initially, the group generated 
a set of descriptions of the types of personnel most critically needed for 
educational innovation. The comprehensive quality of this list was guaranteed 
by the different points of view, ranging from research agencies to school 
systems, represented in the Consortium. The next task set before the Consor- 
tium was to determine the critical skills needed by R & D personnel; this 
involved an extensive job and task analysis. From this topic, the Consortium 
moved to a discussion of the training approaches most effective in filling 
the identified manpower needs. In the final weeks of the design phase the '' 
Consortium discussions centered on a detailed scrutiny of the specific training 
programs, and on the ways in which each agency could contribute and benefit. 

The Consortium as a body has not been a task force; it has been a forum. 
Actual work has been best accomplished by individual members of the Consortium, 
or by small task forces. The particular expertise of each member was called 
upon in preparing reports on what the training programs should and could 
accomplish and the means to do so. These reports were integrated by the project 
director and distributed to Consortium members for their reactions. Feedback 
and resulting discussions were not restricted to the monthly meetings; hence 
the Consortium has been continually active in the work, assessment, and 
direction of the design project. 

The varied composition of the Consortium led quickly to rejection of the 
conventional "pipeline" model of the educational change process, and its 
replacement with a more dynamic model. Change was not seen as a linear process 
of research, development, diffusion, installation, and evaluation but rather 
as a continual interrelation of concerns and skills involving all the agencies 
in the educational network. This model is central to plans for the operational 
phase. 
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The Consortium Model for the Operational Phase 

The Consortium organization that developed during the design phase is 
the skeleton model for the operational phase. The amount and quality of 
design work indicates that the model is a viable one: there is every reason 
to believe that the Consortium will continue to work effectively throughout 
the operational phase. Though the functional emphasis obviotisly will shift 
from the design of training to the developrront and conduct of training 
programs, and the optimum utilization of trained personnel, the initial com- 
position and structure of the Consortium will remain essentially unchanged. 
All agencies holding membership during the design phase have indicated their 
intent to retain membership. During the operational phase, the Consortium will 
be composed of those agencies listed, with their representatives, beginning 
on page Brief vitae of the represent-*. ♦rives are included beginning on page 

The organization and functions of the operational-phase Consortium are 
specified in a formal Working Agreement. Officials of 14 of the 15 present 
member agencies h-ve signed this agreement to date; the fifteenth has made an 
oral statement of intent to participate. The Working Agreement is presented 
beginning on page of this section of the report; its key points are 
summarized below: 



1. The Consortium will have two functions during the operational phase. 
As a formal organization, it will make policy re the objectives and 
procedures of the training programs. As a functional network of 
agencies, it will provide resources and sites for training, trainees, 
and jobs for graduates of t aining programs. 

2. Membership in the Consortium will continue to be open to organizations 
committed to the goals of the project. Such organizations will be 
invited to join with the approval of the then-current membership. 

3. The- Consortium will elect a Steering Committee representing each of 
the major types of agenci.*:?.,; holding membership. The Steering Committee 
will recommend policy, advise on contractual agreements, and recommend 
specif icatir ^s for instruction. 

A. The Steering Committe will elect a Project Director who must be a 
member of the staff of LRDC and approved by the School of Education, 
University of Pittsburgh. 

5. The specific contributions of each of the agencies to the operational 
test will be delineated in individual working agreements. 



Anticipated Participation of Consortium Members in the Operational Phase 

A questionnair "as ms .led to all Consorf' ^m members in November 1970, 
asking for an indication of the specific ways in which their agencies were 
prepared to contribute to the preparation for and conduct of the training 
programs. The sense of their responses for each of the four training programs 
is recorded in Charts 1-4 on pages 3-6. The results are summarized below, 
listed under the related questions. 

ERIC 
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C:i/VRT I. CONSORTIUM MEMBERS' RESPONSES TO QUESTIONAIRE RL PROGR--VM 1: 
S110RT-TER.M TR^MNING PROGR.\-M TO BUILD CURRICULUM >L-\TKR1ALS 





of trainees 
from afiencv 


Z>\ly L L / L 

leased time 
for trainees? 


Offer jobs 
to graduates? 


iciKe paru in 

materials 

development? 


I r 0 V 1 G t 
instructors , 
lecturers? 


1 Pitts- 
' burgh 
P.S. 















B*win- 
WMiall 
P.S. 


6 max. 


released time 
for follow-up 


t*rta^^Ki net r»oc 

if certified 


yes 


yes 


Avon~ 
worth 
P.S. 


1 


released time 
for follow-up 


part-time 


yes 


no 


Phila- 
delphia 
P.S. 

















Ale^hv - 
County 
P.S. 
















Penna . 
Dept. 
of Ed . 


12 


ca 1 afv t'favp 1 

released time 
for follow-up 


yes 


yes 


yes 


WQED 

















U. Pitt 
School 
of Ed. 


(no formal i 


reply at time o 


f publication) 






CMU 


5-10 


no 


no 


yes 


yes 


Tcbrs . 
College 

















Mcoraw- 
Hill 
Pub. Co. 


(no formal ] 


reply at time o 


i publication) 






AIR 






possibly 


yes 


yes 


ASA 


2 


small stipend, 
released time 
for foxlow-up 


yes 


1 

yes 


yes 


RBS 


2 


salary, travel, 
released time 
for follow-up 


yes 


yes 


yes 


LRDC 


4-5 


small stipend 
J — ^, — . 


yes 


yes 

1 


yes 



CHART 2. CONSORTIUM MEMBERS' RESPONSES TO QUESTIONAIRE RE PROGR^uM 2. 

LONG-TERM TRAINING PROGR.VM TO BUILD CURRICLXUM MATERIALS 





Potential Potential no 
trainees now internships 
at agency? at agency 


Offer jobs to 
graduates? 


1 Take part in 
' materials 
} development? 


Provide 
instructors , 
lecturers? 


• Pitts- 
burgh 
P.S. 


yes 2-3 


uncertain 


t r 

no 


no 


B Win- 
W'hall 
P.S. 


uncertain j 1 

' L 


teaching pos. 
if certified 


yes 


yes 


Avon- 
worth 
P.S. 





{ 
j 





! 


Phila- 
delpl a 
P.S. 


yes 


2-5 i yes 


yes 


yes ' 


Alghy. 
County 
P.S. 


yes 


2-3 


yes 


no 


yes 


Penna. 
Dept. 
of Educ. 





___ 


___ 







WQED 


no 


1 


yes 


no 


yes 


U. Pitt 
School 
of Educ. 


(no formal r 


I 

eply at thae of publication) 

1— ' 






! CMU 

1 

1 


no 


I 

5-10 i no 

1 


yes 


yes 


Tchrs. 
College 




1 

i 








McGraw- 
Hill 
Pub. Co. 


(no formal re 


sply at time of publication) 






AIR 


no 


j 

3 max. j yes 


yes 


yes 


ASA 


yes 


1 2 ' 

i-z yes 

i 


yes 1 

i 


yes 


RBS 


* 

yes 


8-10 


yes 


yes 


yes 


LRDC 


yes 


2-3 


yes, 


yes 


yes 



i 



r 
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CILVRT 3. CONSORTIUM MEMBERS ' RESPONSES TO QUESTIONAIRE RE PROGR^VM 3: 
SHORT-TERM TRAINING PROGR^\M TO DESIGN LOCAL CHiVNGE PROGR.VMS 





Potential no. 
of trainees 
from agency 


Support/re- 
leased time 
for trainees? 


1 
1 

Offer jobs ! 
to graduates? ; 


Take part in 

materials 

development? 


Provide 

instructors, 

lecturers? 


Pitts- 
burgh 
P.S. 


1-2 


released time 
for follow-up 
only 


return to 

former 

position 


no 


no 


B'win- 
W'hall 
P.S. 


3 max. 


small stipend , 
released time 
for follow-up 


teaching pos. 
if certified 

1 


yes 


yes 


Av 

wot -h 
P.S. 


1 


small stipend 
released time 
for folicw-up 


yes ' yes 


no 


Phila- j 
deiphia ' 2-5 
P.S. ! 


released time 
for foliow-up 
only 


yes « yes 


yes 


Alghy . 1 

County j uncert. 
P.S. ! 


! 1 

j ! no 


yes 


Penna. 1 

Dept. ' 4-20 
of Educ. ! 


travel , salary 
released time 
for follow-up 


yej 


no 


yes 


1 ■ 

WQED 1 











U. Pitt 
School 
of Educ. 


(no formal re 


i 

ply at time of 


1 

publication) 






CMU 








yes 


yes 


Tchrs . 
College 






! 
1 





McGraw- 
Hill 
Pub. Co. 


(no formal re 


3ly at time of publication) } 
1 




AIR 






1 

1 yes 

j 

i 


yes 


ASA 


2 


small stipend 
released time 
for follow-up 


i 

yes ! yes 

i 


yes 


RBS 


2 


travel , salary 
released time 
for fo] low-up 


yes 1 yes 


yes 


LRDC 

i 


1-2 


small stipend 
i released time 
1 for follow-up 


; yes ; yes 


yes 



CHART 4. CONSORTIUM MEMBERS' RESPONSES TO QUESTIONAIRE RE PROGRAM 4: 

LONG-TERM TRAINING TO DESIGN AND CONDUCT LOCAL CHANGE PROGIC^uMS 





Potential 
trainees now 
at aaencv? 


Potential no. 
internships 
at agencv 


Offer jobs to 
graduates? 


t 

Take part in 

materials 

development? 


Provide ' 
instructors , j 

lecturers? 1 


Pitts- 
burgh 
P.S. 


yes 


2-3 


uncert . 


no 


1 

\ 


B'win- 
Whall 
P.S. 


yes 


1 


yes 


yes 


1 

yes ! 

1 




Avon- 
worth 
P.S. 














! 


Phila- 
delphia 
P.S. 


yes 


2-5 


yes 


yes j 


yes 

i 


Alghy . 
County 
P.S. 













i 
i 


Penna. 
Dept. 
of Educ. 


no 











- ■ 


WQED 


no 


1 


yes 


no 


yes j 


U. Pitt 
School 
of Educ, 


(no formal r 


eply at time of 


publication) 






CMU 










yes 


yes 


Tchrs. 
College 





2 




yes 


yes 


McGraw- 
Hill 
Pub. Co 


(no formal i 


eply at time 61 


. publication) 


i 




AIR 






i 

i yes 

i 


yes 


ASA 


yes 


1-2 


yes i yes 
1 


yes 


RBS 




4 


1 

yes 1 yes 
1 


yes 


LRDC 


yes 


1 

1 


1 

j 

yes ) yes 

1 : 


yes 

— — — 
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Pot ential number of trainees from the agencies . Though enrollment in 
the programs will not be restricted to employees of the Consortium agencies, 
the members' responses to this question indicates the programs' relevance 
to such agencies, and the minimum pool of applicants from which the trainees 
will be drawn. For Programl, seven agencies indicated that a number of their 
employees are interested in enrolling, with a total minimum-maximum estimate 
of 26-38 applicants. Eight agencies responded positively for Program 3, with 
an estimated 14-37 applicants. For the long-term Programs 2 and 4, the mem- - 
bers were not asked to estimate the number of potential trainees from their 
agencies, but simply whether any current employees were interested. Six 
agencies responded positively for Program 2, five for Program 4. 

Degree of support for Program 1 and 3 from the agencies . The variety 
of responses to this question prevents any significant summary. All but 
one of the agencies will offer some support to their enrolled employees; 
specific figures must be negotiated when the trainees enter the program. 

Internships for Programs 2 and A . Ten members will offer internships 
to trainees in Program 2, with a possible 25-41 positions available. Eight 
members will offer internships for Program 4, totalling 14-19 positions. 

Possible jobs for program graduates . Seven age^-ies anticipate possible 
job offers to graduates of Program 1; eight for Prog .m 2; eight for Program ^S; 
and six for Program 4. 

Participation in materials development . All but three of the agencies 
responding to the questionnaire at the time of this writing have agreed to 
participate in the development of training materials for one or both of the 
two major content areas. The roles that each agency will play in this work 
are discussed in the materials development section of Part IXC: Scope of Work, 
of this report. 

Participation in on-sit.e instruction . Ten agencies have employees who 
probably will offer regular instruction and/or occasional lectures in the 
training programs. (An eleventh, the University of Pittsburgh, School of 
Education, clearly will contribute in this way, though no formal response to 
the questionnaire has been offered to date.) 

The relationship of the University of Pittsburgh, School of Education to 
the Consortium and the training programs in general calls for some explrnation 
for it is multi-facetco. First, the School of Education will provide the 
academic context in which the programs will operate. The granting of credits, 
degrees, and certification requires this formal relationship. To provide the 
necessary official status for the programs, the School of Education will create 
the special program in Instructional Development consisting of the Consortiums- 
based training programs. Though the programs therefore will be nominally 
sponsored by the School of Education, responsibility for them will remain with 
the Consortium through a directorship jointly established by the Consortium 
and the School of Education. 
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The second kind of University involvement is that of three School of 
Education departments with membership in the Consortium. These are the 
departments of Educational Cominunications , Educational and Developmental 
Psychology, and Educational Research. Each has made significant contri- 
butions to the design of the programs and will continue to contribute sub- 
•tantialy to them through developing materials, providing instruction, and 
offering related courses within their deparments. 

A third kind of relationship is that of individuals contributing to 
the project. Many LRDC senior staff members hold faculty or administrative 
appointments within the School of Education. It is anticipated that a 
number of these individuals will contribute to the conduct and evaluation 
of the programs in their faculty capacities. Other School of Education faculty 
members wno are not on the LRDC staff will make similar contributions. 

Prospective Expansion of the Consortium 

Though current Consortium membership provide a broad representation of 
educational contexts and perspectives, there is a clear advantage to expansion 
of membership in two directions; the Working Agreement provides for such expan- 
sion. Specifically, it is desirable to broaden the geographic scope of the 
Consortium and to invite the participation of organizations outside the estab- 
lished educational network that nonetheless have demonstrated a strong interest 
in educational innovation. Preliminary steps have been taken toward both ends. 

As concerns geographic expansion, there is a number of paths available 
to the Consortium. First, several member agencies have established or are a 
part of national organizations. Of particular note are WQED-TV which plays 
a leading role in the National Educational Television network; the American 
Institutes for Research with main offices in Washington, D.C., Palo Alto, 
California, and Pittsburgh; and Research for Better Schools which has built 
a national diffusion network for the program of Individually Prescribed 
Instruction. Through these established networks, the training programs can 
recruit nationally and can offer nationally-distributed internships and jobs. 

National scope can also be achieved by admitting new members. The 
present Consortium has voiced a strong interest in the possibility thai, 
the Great Cities Schools Research Council may join after the operational 
test gets underway. Also, a representative of the Chicago-based program 
in urban studies jointly sponsored by the Associated Colleges of the Mid-West 
and Valparaiso University, Indiana has expressed interest in the possible 
participation of his organization in the programs, particularly as a source 
of trainees and as a site for positions in urban education. 

Means of expanding the types of organizational representation on the 
Consortium alt»o have been explored. A number of Pittsburgh community-ar.tion 
groups have expressed strong interest in joining the Consortium. These 
include Pittsburgh Model Cities, the Urban League, Forever Action Together, 
(a Black coiiimunity service organization), and the Bidwell Cultural and 
Training Center, which operates a number of educational programs at the 
pre-school, elementary, secondary, and adult levels. Alx of these organiza- 
tions have active programs for the improvement of urban and minority-group 
education; all are eager for training programs to Improve their ef f eel -fveness; 
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and all offer a perspective on change that can be of immense value to 
the training programs. 

If expansion of the membership and refinement of the structure of 
the Consortium proceed as anticipated during the operational phase, the 
result will be a fully-developed, diffusable model for an educational 
training organization that encompasses all major points of view relative 
to educational improvement, and that assures optimum utilization of 
skilled personnel. The model will be one that is easily established in 
any metropolitan region. 
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MEMBERS OP THE PROJECT CONSORTIUM 



Learning Research and Dr. Glen Heathers, Project Director. Research 

Development Center Associate, LRDC; Professor of Educational and 

Developmental Psychology 

Dr. John 0. Bolvin. Associate Director, LRDC; 
Executive Associate to the Dean, School of 
Education 

Dr. William W. Cooley. Co-Director LRDC; 
Professor of E^ . cation. Professor o^ Computer 
Science 

Dr. Richard C. Oox. Research Associate, LRDC; 
Director, Office of Measurament and Evaluation 

Dr. Robert Glaser. Director, LRDC; Professor 
of Psychology ^md of Education 

Dr. James Holland. Research Associate, LRDC; 
Associate Professor of Psychology 

Dr. CM. Lindvall. Research Associate, LRDC; 
Professor of Education 

Dr. Anthony J. Nitlco. Research Associate, LFJX:; 
Assistant Professor of Education 

Dr. Lauren B. Resnick. Research Associate, LRDC; 
Assistant Professor of Psychology and of Educa- 
tional Psychology 

Dr. Wajran Shepler. Research Associate, LRDC; 
Associate Professor of Education 

Dr. John L. Yeager. Associate Director for 
Administration, LRDC; Associate Professor of 
Education 



Research for Better 
Schools, Inc. 
Philadelphia, Penna. 



Dr. Robert Scanlon. Director, Individualizing 
Learning Program 

Dr. Donald Deep. Research Associate, and Project 
Director of Adult Education Research 



University of Pittsburgh 



Dr. Robert Cox. Chairman of Educational Commun- 
ications 



Dr. Barbara Seels. Assistant Professor of 
Educational Communications 
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Dr, Michael Gladls* Associate Professor and 
Associate Chairman of Educational Psychology 

Dr, J. Steel Gow, Jr. Associate Provost, 
Division of Instructional Experimentation 

Dr. Henry Hausdorff • Chairman, Educational 
Research Department 

^r, J-^jnes Kelly, Jr. 

Associate Dean in Urban Education 



Carnegie-Mellon University 



Dr. Garlle Forehand 

Chairman, Psychology Department 



Teachers College 
Columbia University 



Dr. Francis lannl. Director, Horace Mann- 
Llncolr Institute of School Experimentation 



Dr. Frank Smith. Director, Field Studies 
Evaluation Unit 



Pennsylvania State 
Department of Education 



Dr. Paul B. Campbell. Director, Office of 
Educational Research and Statistics 



Dr. Robert Hayes. Director, Bureau of 
Educational Research 



Allegheny County Schools 



Dr. Fred Krause, Assistant Superintendant, 
Research and Development 



Avonworth Union 
School District 



Mr, Robert F. Jordan 
Supervising Prlnclp,il 



Ba Idw in- Wh 1 1 eha 1 1 
School District 



Dr. Ernest Harrison 
Superintendent 



Philadelphia Public 
School District 



Dr. Johrt Peper. Acting Executive Director, 
Research and Development 



Pittsburgh Board of 
Public Instruction 



Dr. Merwln L. Hiramler. Assistant Superintendent, 
Research and Development 



WQED-TV 



Miss Rhe- Sikes. Director, School Service? 
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Dr. Mary Sceiford. Assistant Director, 
School Services 



American Institutes 
for Research 



Dr. George Cropper 
Senior Research Scientist 



Applied Science Associates Dr. John D. Policy, Jr. 

President 

Dr. Kenneth I. Rifkin 
Associate Staff Scientist 



McGraw-Hill Book Company 



Mr. David Engler. Group Vice-President, 
Instructional Technology 



ERLC 



VITAE OF REPRESENTATIVES OF CONSORTIUM AGENCIES 



LEARNING RESEARCH AND DEVELOPMENT CENTER 
Glen Heathers 

Professor of Education and Research Associate, Learning Research and 
Development Center, University of Pittsburgh, Previously Professor of 
Educational Psychology and Director of Experimental Teaching Center, 
New York University. Coordinator of field test of The Dual Progress 
Plan. Author; Organizing Schools Through the Dual Progress Plan , 
Danville Illinois: Interstate, 1967. Ph.D., Psychology, Yale University 
1939. Dr. Heathers had written extensively on school organization with 
stress on individualized instruction. Also he has designed and conducted 
programs in teacher education. 

John 0. Bolvin 

Associate Director, Learning Research and Development Center and 
Professor of Education, University of Pittsburgh. Director of Indiv- 
idually Prescribed Instruction Program, LRDC. Member of American 
Educational Research Association's task force on Training of Educational 
Research Personnel. Ed.D., University of Pittsburgh, 1958. Dr. Bolvin's 
chief interests are in research and development on individualized instruc- 
tion, concentrating on teacher diagnosis and lesson planning, and the 
use of student perfon:iance for curriculum evaluation and modification. 

William W, Cooley 

Co-Director, Learning Research and Development Center and Professor of 
Education and Computer Science, University of Pittsburgh. Previously 
Director of Project TALENT, University of Pittsburgh and American Insti- 
tutues for Research. Co-author: Multivariate Procedures for the Behav- 
ioral Sciences Exercises (J. Wiley, 1968), Multivariate Data Analysis 
(J. Wiley, 1971). Ed.D., Educational Research, Harvard University, 1958. 
His current research conerns the applications of computer technology and 
statistical and measurement techniques to the support of individually 
prescribed instruction. 

Richard C. Cox 

Research Associate, Learning Research and Development Center and Associate 
Professor of Education, University of Pittsburgh. Formerly Director of 
Measurement and Evaluation Unit within LRDC. Director of Office of 
Measurement and Evaluation, University of Pittsburgh. Ph.D., Michigan 
State University, 196A. Dr. Cox has a special interest in assessing the 
effectiveness of a procedure of sequential testing involving placement 
testing, curriculum-embedded testing, and lesson-unit testing as steps 
in identifying the instructional needs of the individual pupil. 



Robert Glaser 



Director, Learning Research and Development Center and Professor of 
Psychology and Education, University of Pittsburgh. Past Director 
of Programed Learning Laboratory, and Testing and Measurement Service, 
University of Pittsburgh; and Research Advisor to American Institutes 
for Research. Currently a member of the Education and Training Board, 
APA; Advisor on Computing Activities, National Science Foundation; 
Series Editor for Instruction, Learning and Developmental Psychology, 
Prentice-Hall; President-Elect, AERA; President-Elect , Division of 
Educational Psychology, APA; Fellow, Center for Advanced Study in the 
Behavioral Sciences, 1969-70. Contributing editor of Teaching Machine ; 
and Programed Learning . Vols. I and II, NEA, 1960, 1965, and Training 
Research and Education , Wiley, 1962; Editor, Organizations for Research 
and Development in Education , AERA/PDK, 1966. Ph.D. in Psychology, 
Indiana University, 1949. Dr. Glaser is currently conducting research 
on the technology of instruction. 

James Holland 

Associate Professor of Psychology and Research Associate, Learning 
Research and Development Center, University of Pittsburgh. Previously 
Lecturer, Research Associate, and Executive Secretary to the Coitmittee 
on Programed Instruction, Harvard University. Author: (with B.F. Skinner) 
The Analysis of Behavior ; A Program for Self-Instruction , (McGraw-Hill, 
1961); "Technique for the Behavioral Analysis of Human Observing", Science, 
1957, 125, 348-350. "A Quantitive Measure for Programed Instruction," 
American Educational Research Journal , 1967, 4_, 87-101. Ph.D. in Psychol- 
ogy, University of Virginia, 1955. Dr. Holland's principle areas of 
investigation are programed instruction, teaching machines, and operant 
conditioning. 

C. Mauri tz Lindvall 

Research Associate, Learning Research and Development Center and 
Professor of Education, University of Pittsburgh. Head of Field 
Studies Programs at LRDC. Heretofore Chairman of Educational Research 
Programs and Associate Director of the Coord-&:'.ated Education Center, 
University of Pittsburgh. Author of Testing and E^yaluatio n, Harcourt, 
Brace St World, 1961; Defining Instructional Objectives , Univarsity of 
Pittsburgh Press, 1964; Measuring Pupil Achievement and Aptitudes , 
Harcourt, Brace & World, 1967. Ed.D., University of Illinois, 1953. 
Dr. Lindvall 's research interests center in formative evaluation and 
ics use in building curriculum. 

Anthony J. Nitko 

Research As^ -liate. Learning Research and Development Center, and 
Assista* fissor of Education, University of Pittsburgh. Co-?.fthor 

with Ro^ ,iser of chapter on "Measurement in Learning and Instruction'* 

to appec -^he revision of Educational Measurement (R.L. Thorndike, ed.). 
Ph.D., Statu University of Iowa, 1968. His interests focus on testing in 
individualized instructional systems. 



Lauren B. Resnick 



Assistant Professor of Psychology and Director, Primary Educatlbn Project » 
Learning Research and Development Center, University of Pittsburgh. Author: 
**Progrcmed Instruction and the Teaching of Complex Intellectual Skills.* 
Harvard Educational Review , 1963, 32» ^39-471. "Design of an Early Learning 
Curriculum." LRDC Working Paper , 1967. With Margart^t Wang: "Approaches to 
the Validation of Learning Hierarchies." Proceedings oj t h e Eighteenth 
Western Regional Conference on Testing Problems . Princeton, Nev Jersey: 
Educational Testing Service, 1969. Ed.D. , Harvard University, 1965. 
Dr. Resnick has conducted research and development projects on early learning, 
language and the special learning problems of the disadvantaged. 

Warren Shepler 

Associate Professor of Education and Research Associate, Learning 
Research and Development Center, University of Pittsburgh. Pre- 
viously Assistant Superintendent of Schools, Harrisburg, Pa. and 
Assistant Superintendent of Schools, Balduin-Whitehall Schools, Pa. 
Publications : "Model for Individualizing Instruction." The Northern 
Illinois Cooperative Educational Journal , Northern Illinois University, 
,1970. D.Ed., University of Pittsburgh, 1955. Dr. Shepler currently 
is involved in developing a supervisory and teacher training model for 
the H.E.W. Follow Through Program. He also is Project Leader to the 
sponsor staff serving the ''ive Follow Through school systems. 

John Yeager 

Associate Director, Learning Research and Development Center, and 
Associate Professor of Education, University of Pittsburgh, Ed.D., ' 
University of Pittsburgh, 1966. Dr. Yeager' s research interests 
lie in the areas of instructional design, student learning rates, 
and research and development management systems. 



RESEARCH FOR BETTER SCHOOLS, INC. 



Program Director, Individualized Learning Program, Research for Better 
Schools, Philadelphir, Pa. Previously Elementary Administrator, Oakleaf 
Elementary School, Ba-.dwin-Whitehall School District, Pa., and Director 
of Elementary Education at the Middletcrwn, New York public schools. 
Publications : ''The Expansion of an Innovation, '' Audio-Visu al Instruction, 
November, 1968; (with Mary Brown) '^In-Service Education for Individualized 
Instruction," Educational Technology , February 1970; "Individually Pres- 
cribed. Instruction: A System of Individualized Instruction," Educational 
Technolog y, December 1970. Ed.D., Elementary Education, University of 
Pittsburgh, 1966. Dr. Sci^.nlon's professional interests are in curriculum 
development, the training of educational personnel, individualizing 
instruction, and the dissemination of innovations in instruction. 
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Donald Deep 



Research Associate and Project Director of Adult Education Research, 
Research for Better Schools, Philadelphia, Pa; formerly Research Con- 
sultant to Project PLaN at Westinghouse Learning Corporation, Research 
Associate at LRDC, and Principal, Oakleaf Elementary Schools of the 
Baldwin-Whitehall School District. Published articles ; "The Computer 
Can Help Individualize Instruction," Elementary School Journal , February, 
1970; "The Teacher's Changing Role," Elementary School Journal , November, 
1968. Ed.D., University of Pittsburgh, 10(>6. Dr. Deep's interests focus 
on individualized instruction at elementary, secondary, and adult levels. 
Also he specializes in curriculum development and the training of school 
administrators and teachers. 

UNIVERSITY OF PITTSBURGH 
Robert A. Cox 

Chairman, Department of Educational Communications, School of Education 
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uwiiiLU, U.S.A.I.D., and the governments of Kenya, Tanzania, Venezuela 
and Columbia. Author: "Educational Technology in Developing Nations'" 
chapter in Education i n National Development . London: Routledge and ' 
Kegan Paul, 1971; "International Use of Computers for Media Control" 
Audiovisual Instruction, April 1967. Ed.D. in Instructional Communications, 
Syracuse University, 1967. Dr. Cox's professional interests are in the 
process of technology in the development of higher education, teacher 
training, and in the development, utilization, and evaluation of 
innovative educational systems in the United State and other nations. 

Barbara A. Seels 

Assistant Professor, Department of Educational Communications. School 
of Education, University of Pittsburgh. Previously coordinator of 
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dhliny r"^ - by 'he International Reading As^oci^f tion; 411 

Tiln lZ ^^'^'^"l dissertation: CommunTca- 
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prinMnL; specialized in the development of message dISn 

principles based on research and practice. aesign 

Michael Gladis 

Associate Professor of Education and Associate Chairman of Department 
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Henry Hausdorff 

Chairman of Department of Educational Research and Professor of Education, 
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Project Follow Through, 1967-68. Co-prlnclpal Investigator In evaluation 
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University of Buffalo, 1962. Dr- Hausdroff *s Interests center on eval- 
uating school programs and on research design concerning applied research 
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Chairman of Philosophy Department at Western Virginia State College; 
Associate Director of National NDEA Institute for Advanced Study in 
Teaching Disadvantaged Youth (1966-68). Consultant to Southeast, 
Appalachian, and Northwest Regional Educational Laboratories. Contri- 
butor to Teachers for the Real World (AACTE), 1969, and Education for 
Personal and Family Living - a Working Guide for Colleges , 1957. B.D., 
Howard University. M.Ed. In Education and Anthropology, Marshall 
University. He was a student in the community development program at 
Western University, studied pupil personnel services at the University 
of Pennsylvania and Harvard, and studied higher education at the 
University of Denver and the University of Pittsburgh. 
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Journal of Educational Measurement , 1966, 199-204; Individual Differences 
in Problem Solving Processes of College Students , Cooperative Research Project 
No* 3151, U.S. Office of Education, Carnegie-Mellon University, 1967; 
"Functions of a Curriculum Evaluation System," Teachers College Record 
(in press), Ph.D., Psychology, University of Illinois, 1958. Dr. Forehand's 
interests are in psychological measurement, educational research, and 
cognitive processes. 
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Associate Professor of Education, Department of Educational Administration, 
and Director, Field Evaluation Unit, Horace Mann-Lincoln Institute. Pre- 
viously Associate Principal, Ridgewood, New Jersey, High School. Author: 
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(with Bellack, et. al.) The Language of the Classroom , Teachers College 
Press, Columbia University, 1966. Director of NASSP Study of High Schools 
in the Forty-Five Largest Cities. Consultant on the reorganization of 
secondary education through the development of local change advocates in 
several metropolitan districts. Ed.D., Secondary School Adminstration 
and Curriculum, Columbia University, 1963. Dr. Smith has a particular 
interest in classroom interaction systems. 
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Paul B» Campbell 

Director, Office of Educational Research and Statistics, Pennsylvania 
Department of Education. Previously director of the Bureau of Educa- 
tional Quality Assessment, Pennsylvania Department of Education; 
Coordinator of Instructional Research and Development Services, 
Livonia Public School System, Livonia, Michigan; and instructor in 
tests, measurement and evaluation, Eastern Michigan University Field 
Services. Author: "The Pennsylvania Plan," Section 1 of Phase II 
Findings , Burea of Educational Quality Assessment, July, 1970; and 
"School and Self -Concept," Educational Leadership , March 1967. Ed»D. 
in Evaluation and Research, Wayne State University, 1965. Major 
interests are educational goal definition, evaluation, and test 
construction. 
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Director, Bureau of Educational Research, Pennsylvania Department 
of Education; Member, Board of Directors, Appalachia Educational 
Laboratory. Author: Articles in Instructional Improvement Through 
Research, New York State Education Department and ERANYS, 1965; 
AV Communication Review ^l966; Journal of Teacher Education^ l963; 
Journal of Educational Research ,1963; The Reading Teacher .^1966, 1967, 
and 1969. D.Ed., Pennsylvania State University, 1961. His major 
interest is related to education management of applied research to 
improve teaching and learning. 
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Fred C. Krause 

Assistant County Superintendent in Charge of Research and Development, 
Allegheny County Schools ^ Director, Educational Development Center, 
Region D, Pennsylvania Department of Education. Ed.D. in Guidance and 
Psychology, University of Pittsburgh, 1955. Post-doctoral study in 
Elementary and Special Education at the University of Pittsburgh and 
Indiana University. Dr. Krause has held faculty positions at the 
University of Virginia. 
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Supervising Principal, Avonworth School District. Previously Assistant 
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J» Ernest Harrison 
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Superintendent and Director of Curriculum and Research for the same dis^ 
trict. Publications ; Dissertation - "Achievement of Selected Types of 
Educational Objectives Through Use of Programed Materials." Co-Author - 
Program of Elementary Schience Education , Parco Scientific Inc., Warren, 
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University of Pittsburgh, 1957. 
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Association of Educational Broadcasters. Author: "The Contributions 
of the Producer-Director in Improving Instruction: Summary Statement", 
Improvement of Teaching by Television , Griffith and MacLennon, Eds., 
Columbia, Mo., 196 A. Editor: Teacher's Guide to Classroom Television , 
WQED-TV, Pittsburgh, Pa., annually 1959-1971. M.S. in Radio-Television, 
Syracuse University, 1954. Miss Sikes holds a wide range of consulting 
positions in public and educational television, and lectures in educational 
communications at the University of Pittsburgh. 
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Previously Classroom Teacher in Ohio and Wisconsin; Art Teacher, Grades 
1-9, Mt. Lebanon School District, Pittsburgh, Pa. Author: Curriculum 
Guide for Art Education , Grades 1-6; Study Guide for Telecourse , WQED-TV; 
Dissertation: Instructional Television Prcducer^User Communications in 
New York State ^ Ph.D. in Instructional Technology, Syracuse University, 
1969. Dr. Sceiford *s primary interest is in the development, dissemination, 
and utilization of instructional television courses whicli will provide 
meaningful learning experiences. 
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George L. Gropper 

Principal Research Scientist and Director, Instructional Media Studies, 
The American Institutes for Research, Pittsburgh. Co-author: G.L. Cropper 
and J.G. Short, Design of a Training Development System , Pittsburgh: American 
Institutes for Research, 1968; G.L. Cropper and Z. Glasgow, Criteria for 
the Selection and Use of Visuals in Instruction , Pittsburgh: American Insti- 
tutues for Research, 1969. Ph.D. in Industrial Psychology, University of 
Pittsburgh, 1956. Dr. Cropper's major work in research and development 
concerns contributions to and applications of instructional technology. 
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President and General Manager, Applied Science Associates, Valencia, 
Pennsylvania. Previously Program Director at the American Institutes 
for Research. Ph.D., Psychology, Carnegie Institute of Technology, 
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formance aids and job-oriented training to promote effective and effi- 
cient 1ob performance. His background includes a degree in Mechanical 
Engiiicering from Stevens Institute of Technology. 

Kenneth I, Rifkl n 

Associate Staff Scientist, Applied Science Associates. Previously a 
research associate in the Minut^iman Program Office, Personnel Subsystem 
Section, Sylvania Electronics. Ph.D. in Experimental Psychology, 
Tufts University, 1967. Dr. Rifkln had conducted extensive research in 
the areas of visual perception, perceptual learning, and simulation 
training programs. 
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Group Vice-President for Instructional Technology, McGraw-Hill Book 
Company. Formerly Director of Educational Systems Development and 
General Manager of the Instructional Systems Division of the same 
company. Taught for eight years in elementary, junior, and senior 
high schools. Publications ; "instructional Technology and the 
Curriculum/' Phi Delta Kappan , 1970, 51, 379-381; "Problems in 
Defining and Applying Technology to Education," The Application of 
Techonology to Education, Washington, D.C., American Society of 
Engineering Education, 1969. M.A. , Teacher's College, Columbia 
University. Mr. Engler 's interests concern the; development of 
instructional systems and applications of technology to curriculum 
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SCOPE OF WORK 



Introduction 



The work of the operational phase divides into three closely related 

inf ti;rflr«r?r material development, and training. Dur- 

ing the first 12 months of the operational phase, February l 1971! 

iTrl7J, \ 'p''* rll °' ""'^^ ^"'^"^ °" four training programs 

described in Part IIA of this report. ^'"8'*""° 

-^""^ on97r.will be almost exclusively 
devoted to program development and materials development in preparation 
for launching-trilMnrin-airfour pr^aS-s^iirtEir^ummer or fall of that 

f ^''^'^ ^^""'^y "^^'^^ '° "«i"i"g during those 
months will be tnat of r ecruiting trainees for the programs. 

During the month of July 1971, it is planned to launch Programs 1 
and J that, respectively, will offer short-term training in building cur- 
ricular materials and in designing local educational change programs. 
These programs will be initiated with full-time institutes that begin 
with two-week sessions held during JLuiy and continue into the early fall 
with one or two more such sessions (each trainee receiving four to six 
weeks of such training). During the remainder of the fall, and until the 
end of the calendar year, training in these programs will continue with bi- 
weekly day-long workshops. 

During the month of September 1971, it is planned to launch Programs 
2 and A that, respectively, will offer long-term training (two or three 
full-time years in duration) in curriculum development or in the design 
and conduct of local change programs. During the ensuing 12 montus, these 
programs will normally involve full-time study through course work, labs, 
and field observation. (Some trainees may spend a part of the year in 
internship settings.) 

Program and materials, development will continue throughout the initial 
12-month grant period<3uch development activities will be especially heavy 
for Programs 2 and A since the demands of these continuing, full-time pro- 
grams for training materials will go far beyond what can be made ready at 
the time of their launching.) Also, these long-term programs will continue 
to pose many demands for gerteral development activities to devise and em- 
ploy procedures for implementing, assessing, and revising program efforts. 

The six-month period from February through July 1972 will see the con- ,^ 
tinuation of Programs 2 and A and will involve a heavy commUment to pro- 3 
gram and materials development for two new major programs : (Program 5 that ^ 
will provide long-term training to develop training programs for educational . 
personnel and Program 6 that will offer long-term training in the develop- 
ment of instructional environment systems^ Also, this six-month period 
will involve revision and further developflient of Programs 1-A, employing 
formative-evaluation data from the first tryouts of these programs. Final- 
ly, this period will involve recruiting trainees for the four training 



programs to be activated in the second round, and for the two new pro- 
grams to be launched in September 1972. 

It should be noted that the six training programs still will involve 
training in just two major R&D areas, development and utilization 
(local change programs). The two new programs simply add specialties 
in two areas of development that already will be heavily involved in the 
training of curriculum developers. Many training tasks will be common 
to all of the four specialties in the development area. 

It would be extremely hazardous to offer even tentative commitments 
as to the ways in which the work of the training Consortitim will pro- 
ceed during the last two years of the operational phase (September 
1972 - August 1974) with respect to which training programs will be 
abandoned, continued, or added or with respect to whether efforts will 
be expended on refining and strengthening the training programs or on dif- 
fusing them. A definite expectation is that many components of the 
training programs vill prove to be sound and transportable. A related 
expectation is that the effective diffusion of training units and seg- 
ments, if not of entire programs, will be well under way before the end 
of the operational test. 

Throughout the operational test, major efforts will be directed 
toward strengthening and extending the Consortium model as an agency of 
instructional innovation. Also, efforts will be made continually to 
recruit trainees from various sources, particularly trainees with ex- 
tensive background training or work in fields outside education and 
trainees who represent different sub-populations. 

The following sections set forth the work that will be performed 
in each of six areas corresponding to the break-out of the budget re- 
quest into six distinct segments. 

Program Development, Administration^ and Evaluation, 2/1/71 - 1/31/72 

The work in program development during the first 12-month grant 
period will fall into four closely related areas. These are outlined 
below, 

A. Building detailed specifications and procedures for the four 

training programs to be introduced in the summer and fall of 1971 . 
(Descriptions of these programs are given in Part IIA of this 
report.) The specifications must include a detailed plan for 
conducting training during the first year. This demands decisions 
(and their implementation) concerning specifically what is to 
be taught in each program, what instructional approaches will 
be employed, what instructional settings will be- used, how 
individualized instruction will be employed, and how the pro- 
grams will be administered • Detailed plans for implementing 
each of the four programs must be developed. 



B. Building the program In Instructional Development within the 
School of Education at the University of Pittsburgh ^ The task 
is to build an inclusive instructional program that will provide 
basic training for any specialty in the development, diffusion/ 
and utilization of instructional innovations. This requires 
working with faculty colleagues to set up the needed adminis- 
trative structure for trainee admission, program planning, 
counseling and guidance, instruction, progress assessment, 
and the granting of credits, degrees, and certificates. In 
addition, effective working relationships must be built invol- 
ving faculty from different departments of the University, as 
well as LRDC staff members. 



in 



C. Developing the project Consortium into a functioning agency i: 
the conduct of the program development, materials production, 
and training activities ♦ Ways must be worked out to enlist the 
active and continuing participation of Consortium agencies in 
training program development, materials development, trainee 
recruitment, instruction in the programs, and the placement of 
program graduates. 

D. Building and using instruments and procedures for evaluating the 
development, implementation, and outcomes of the training programs . 
This calls for designing and using specific approaches to forma- 
tive and summative evaluation of different aspects of the work 

and the products of the operational phase. Many of the evalua- 
tion functions that must be carried out are very expensive inas- 
much as they involve behavioral observation and interviews as 
well as less time-demanding procedures. Necessarily, the evalua- 
tion functions will be intimately blended with program development 
to provide the needed formative evaluation. The preparation of 
project reports is one outgrowth of this evaluation function. 

The activities described above will be the work of the project staff. 
They have been budgeted for just in excess of $107,000, almost all of 
which consists of staff salaries, fringe benefits, and indirect costs. 
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Materials Development, 2/1/71 - 1/31/72 

Developing instructional materials for the training programs is an 
essential and separable aspect of program development. Since the training 
programs under development possess many novel features, the great bulk 
of the training materials required have not existed heretofore. The new 
training programs demand a wide variety of materials including programmed 
descriptive texts, extensive practice workbooks, laboratory case and 
sitr^ulation materials, syllabus materials for the theory seminars, a 
number of actual curricula or change programs for the analysis seminars, 
and materials to train the trainers for the programs. Each of the instruc- 
tional units within the proposed programs must include most or all of 
these types. 
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Because of the content differences between the programs in curri- 
culum development and those in local change, the materials development 
work will have two parallel work flows—one for each of the major con- 
tent areas— coordinated through one office. The coordination is essential 
since there is significant overlap, particularly as regards Educational 
R&D Foundations, Evaluation, Project Management, and the general core- 
level or analysis materials for all task areas. 

The resources available to the project for materials development 
from sources external to the project staff can be classified in four 
categories: existing training units (includincr un"-' under development 
elsewhere), materials from Consortium membei ,^ stems, materials 

from Consortium membar university departments. . materials from Con- 
sortium member development agencies. These are discussed in turn below. 

Existing m aterials . A major task during the initial months of the 
operational phase, and continuing throughout the project, is the search 
for and analysis of extant training materials. (This process is discussed 
in Part I, pages 6-7 of this report). To this point, the work has involved 
locating, analyzing, cataloging, and cross-referencing the materials. 
What must follow is a process of adapting and interrelating the materials 
for use in the training progrrms. It is essential that this integrative 
process begin as soon as possible for it is through this process that the 
specific needs for original development of materials will be defined; 
when materials that meet our criteria cannot be found, they must be created. 

The process of building training units from available materials will 
be facilitat_d by the cross-reference system of recording information. 
For each training task (or group of tasks), a single reference sheet indi- 
cates the extent and kind of coverage available in all source material 
on hand. For each document, another reference sheet indicates the tasks 
or training objectives covered by that document, and the extent and kind 
of coverage. The task sheets prescribe which sections, chapters, etc. to 
lift and collate, with adaptive editing, to form instructional units; the 
document sheets suggest possible chains of continuity across instructional 
units. The project staff thus can make optimum use of available materials, 
minimizing the need for the more time-consuming and costly original develop- 
ment activities. 



Materials from Consortium member school systems . The survey process 
probably will uncover few materials that offer the extensive analysis 
and practice opportunities required for effective training. Therefore, 
a complementary search must be conducted that is aimed at developing a' 
bank of "raw materials" for use in analysis seminars and labs. Toward 
this end. Consortium school systems can make a great contribution. Each 
is conducting, or has recently conducted, major innovative programs ranging 
from the installation of an individualized elementary curriculum in a 
small suburban school to the system-wide reorganization of administration 
in a large urban system. The voluminous materials generated during these 
programs constitute valuable case study data for the analysis seminars 
in local ch-.^.vfc; ',?ith restructuring, they can be used for in-basket 
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and simulation exercises for labs. In another vein, the member school 
systems use a great variety of curricular packages. Such packages, 
desQ^ribed in detail with extensive examples, form a materials core for 
the analysis seminar in curriculum development. The availability of 
actual use data for such materials is an added advantaget 

iite^erials from Consortium member university departments * Members of 
.le several university departments connected with the Consortium (at the 
University of Pittsburgh, Carnegie-Mellon University, and Teachers 
College, Columbia University) can contribute a substantial body of 
training materials. First is the identification and sequencing of 
syllabus materials for the theory seminars. Second are materials for 
R&D Foundations, much of which will re^^uire original expository writing. 
Third, faculty members will open their c^^vrses to trainees in the programs. 

Materials from Consortium member dt:velopment: agencies . Several 
Consortium member agencies have extensive professional experience in 
developing training materials, specifically, the Ame^rican Institutes for 
Research, Applied Science Associates, Research for Better Schools, and 
LRDC. These agencies have indicated the willingness to develop sizeable 
portions of the necessary materials, usually on a sub-contractual basis. 
Their contributions will be especially important in the development of 
the programmed descriptive materials at the core levels, and the mater- 
ials required for labs offering guided practice (PI and P2 levels). Much 
of the materials can be gathered from past or current projects within the 
agencies. For example, in the workshops on revising curriculum materials, 
trainees can work on actual materials generated by the development agencies, 
with accompanying pilot-test data. 

it will be the task of project staff members to conduct or coordinate 
the processes of materials gathering and adapting. Further, the project 
staff must do extensive work on a continuing basis to originate, test, 
and refine materials not available from external sources. It is not 
expected that, initially, the training materials placed in use in the 
training programs will be in the form of fully-developed and adequately 
J packaged units that can be diffused generally. Rather, materials as well 

as instructional procedures must be continually evaluated and revised 
throughout the operational phase with the goal of arriving at materials 
and associated proce^lures that are effective, efficient, and in a pack- 
ageable form. 

Associated with the training materials that are located, adapted, or 
built by the staff or Consortium members, it is essential that achievement 
sub-tests of appropriate types be constructed. This is required for 
pre-testing trainees on traininR units and for post-testing them after 
training to determine whether they have mastered unit objectives. 

The budgeted allocat ion ^ or materials development during the first 
12 months is juslc rP^feF'^A ,00fl j. Better than two-thirds of this sum is for 
project staff. Nearly one-third has been set aside for materials develop- 
ment under p'\rchase services contracts. 



- 6 - 



Training In Program 1; Short-Term Progr^ TP to Train Professional Assistants 
to Develop Curriculum Materials, 7/1/71" ' i2/31/7F 

It is planned to conduct the initial tryout of Program 1 with some 
yj' ^ 12 trainees beginning in July 1971 v;ith a two-week full-time institute 
y ^ session, conducting one or two further sessions in the early fall, and 
continuing with five or six bi-weekly one-day workshops. The trainees 
will come from Consortium member agencies where they are, or are becoming, 
employed as professional assistants engaged in writing curriculum materials. 

Program 1, and the general training process to be employed, are 
described in Part IIA of this report, pages 5-8. 

The budget being submitted for support of this training calls for 
just ever $11,000, divided almost equally between salaries for instructional 
staff and trainee support in the form of ( [per di enTexpenses while attending 
( ; -^tl^e training institute or workshops held In Jt^ittsburgfTT^ Salaries and 
'K ^Jtravel expenses., will be paid by the trainees' employers. 



( ' 

Training in Program 2; Long-Term Program to Train Project Directors and 
Professional Assistants in Curriculum Development, 8/1/71 - 1/31/72 



y It is planned to initiate the tryout of Program 2 beginning in 

September 1971. (The initial group of trainees will remain in the program 
for two or three years. It is expected to begin training a second group 
in September 1972, etc.) 

Program 2, and the training process to be employed, are described in 
Part IIA of this report, pages 9- 24. 

The budget being submitted provides for 6 trainees in the initial 
group. The total requested if &147760.: >This is divided almost equally 
between trainee support and institutional allowances for costs of instruc- 
tion. It should be noted that the sum requested is for the first half of 
the first training year; an equivalent sum is included in the budget pro- 
jection for the period 2/1/72 to 7/31/72 (see the final table in the Budgets 
book) . 



Training in Program 3; Short-Term Program to Train Project Directors to 
Design Local Instructional Change Programs, 7/1/71 - 1/31/72 

It is planned to conduct the initial tryoucs of Program 3 with some 
20 trainees beginning in July 1971 with a tx^o-week full-time institute 
session held at Pittsburgh with one group of trainees. One group of about 
12 trainees will consist of employees of the Pennsylvania State Education 
Department, intermediate education units, and school sys.tems. The other 
group will consist of leaders of community-action groups in Pittsburgh who 
are concerned with innovations in instruction related to the concerns of 
their groups. Staggered two-week institute sessions with this group of 



trainees, and with a second group, will be conducted during the fall 
months until each group has had a total of six weeks of training in 
the institute setting. Following the institute, each group will return 
bi-weekly for approximately five one-day V7orkshops. 

Program 3, and the general conduct of instruction in this program, 
are described in Part IIA of this report, pages 25-34. 

The budget submitted for support of Program 3 during the period 
covered is $16,524, The requested sum divides into approximately 60 
per cent for instruction in the program and 40 per cent for trainee 
support in the fom of per diem expenses while^-atTending Institutes or 
workshops. Such support is requested for onl^^lg^f the expected 20 
trainees. The remainder of the trainees will be local residents not 
requiring stipend support • 

Training in Program 4: Long-Term Program to Train Project Directors and 
Professional Assistants to Design and Conduct Loca] Change Programs, (8/1/71-1 

It is planned to begin the initial tryout of Program 4 in September 
1971. (The initial group of trainees, as is the case with Program 2, will 
remain in the program for two or three years. A second group will begin 
training the following September, etc.) The small number of trainees is 
due to the limited funds available to support trainees and to provide the 
intensive individualized instruction required to launch the program. 

Program 4, and the conduct of instruction within the program, are 
described in Part IIA of this report, pages 35-49. 

The budget submitted for support of Program 4 during the period 
covered is $14,760. This is the same figure as that in the budget for 
Program 2. As with Program 2, the sum requested is divided about equally 
between trainee support and institutional allowances for instruction. 
Once again, the sum requested is for the first half of the first training 
year and an equivalent sum is included in the budget projection for the 
period 2/1/72 - 7/31/72 to be found in the final table in the Budgets Book. 



Title: 



FINAL REPORT ON PROJECT TO DESIGN 
NEW PATTERNS FOR TRAINING R&D 
PERSONNEL IN EDUCATION (RFP 70-12) 



Applicant Organization: 



Learning Research and Development Center 
University of Pittsburgh 
Pittsburgh, Pennsylvania 15213 



Initiator: 



Glen Heathers 

Professor of Education, University of Pittsburgh 
Research Associate, Learning Research and 

Development Center 
(412) 683-8641, Ext, 63 



Transmitted by: 



William W/ Coo lev 
Co-Director 
Learning Research and Development Center 
University of Pittsburgh 
(412) 683-8641, Ext. 70 



Date Transmitted: 



18 December 1970 



Taul Solyan 
Comptroller and Assistant Treasurer 
University of Pittsburgh 
Pittsburgh, Pennsylvania 15213 



• cr> 
o 

CO 

o 

FINAL REPORT ON PROJECT TO DESIGN NEW PATTERNS 
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PART I ID 
BUDGETS 



Le arning Research and Development Cente r 
University of Pittsburgh 



December 18, 1970 



BUDGETS 



Introduction 

In order to accomplish the work described in this report, the 
resources set forth in the following budgets will be required^ 

The budget for the first year of the operational phase (2/1/71 - 
1/31/72) is broken down into six (6) parts corresponding to the 
identification of task areas in Scope of Work. Three (3) primary 
types of activity are provided for: program development, materials 
development, and training in each of the four (4) programs. While 
separate budgets are submitted, it is important to recognize that the 
six (6) budgets constitute a single package, all of whose components 
interact. Accordingly, an individual project could not be accomplished 
if the others were not funded. 

It should be noted that the four (4) training programs divide into 
two (2) concerned with curriculum development and two (2) concerned 
with local change programs in school systems^ Also, within each of 
these two (2) types, a long-term and a short-term program will be 
offered. 

The budget for Program Development, Administration and Evaluation 
provides mainly for the project staff that will conduct these activities 
during the project. The Materials Development budget provides salaries 
for staff members who will perform the bulk of the work in this area. 
The budget also provides for parts of materials development to be sub- 
contracted. Funds for Programs 2 and 4, both long-term training programs 
provide mainly trainee support and institutional allowances for trainees 
that will support instruction in the programs. On the other hand, the 
budgets for Programs 1 and 3, both short-term training programs, 
provide trainee support and salaries of an instructional staff in lieu of 
institutional support. 
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Two summary tables indicate total costs for training activities, 
and for program development, materials development, and training 
' taken together. 

The final table offers a projection of OE funds that will be 
needed over the full 42-month period of the operational test. The 
second column is a budget projection for the six-month period February 
to July, 1972. It will be noted that funds for program development 
remain at about the same level over the 42 -month period, that 
materials development costs decline toward the end of the period, and that 
training costs increase toward the end of the operational phase. 



PROGRAM DEVELOPMENT, ADMINISTRATION & EVALUATION 



2/1/71 - 1/31/72 



Salaries 

1 Director @ $24,000/yr. $24,000 

2 Research Asso. @$18,000/yr. 36,000 
2 Research Assts. @$8,000/yr. 16,000 
2 Secretaries @ $5,000/yr. 10,000 

$86,000 $ 86,000 

Fringe Benefits 8,600 

Supplies 2,400 

Travel 1,500 



Communication 



600 

Direct Cost 99, 100 

Indirect Cost (8% of Direct Cost) 7,928 



TOTAL 



$107,028 
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MATERIALS DEVELOPMENT BUDGET 
2/1/71 - 1/31/72 



Salaries 

1 Asso. Professor @ $18, 000/yr. $18,000 

1 Asst. Professor @ $14, 000/yr. 14,000 

2 Research Assts. @ $8, 000/yr. 16,000 
1 Secretary @ $5, 000/yr. 5,000 

$53,000 $53,000 

Fringe Benefits (107o of Salaries) 5,300 

Supplies 3,200 

Travel ^600 

Purchase Services (Materials Production) 24, 000 

Direct Cost 87, 100 

Indirect Cost (8% of Direct Cost) 6,968 

TOTAL $94,068 
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PROGRAM 1 

CURRICULUM DEVELOPMENT (ST) TRAINING BUDGET 
2/1/71 - 1/31/72 

Salaries 

Instructional Staff FTE 

2 @ $18,000/yr. .25 $ 4,500 

Fringe Benefits 450 

Trainee Support (Stipends) 

12 Trainees @ $450/six week period 5,400 

Direct Cost 10,350 
Indirect Cost (8% of Direct Cost) 828 
TOTAL $11,178 



- Short Term 



PROGRAM 2 

CURRICULUM DEVELOPMENT (LT) TRAINING BUDGET 
2/1/71 - 1/31/72 

Trainee Support 

6 Stipends @ $200 /month $ 6,000 

Dependency 

6 @ $500/yr. for .42 years 1,260 - 

T ravel 

6 trips at $200/trip 1,200 

Institutional Allowance 

6 @ $2,500/yr. for .42 years 6, 300 

TOTAL $14,760 



LT - Long Term 
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c 

PROGRAM 3 
LOCAL CHANGE (ST) TRAINING BUDGET 
2/1/71 - 1/31/72 

Salaries 

Instructional Staff FTE 

2 @ $18,000/yr .50 $ 9,000 

Fringe Benefits 900 

Trainee Support (Stipends) 

12 Trainees @ $450/six week period 5,400 

Direct Cost 15, 300 

Indirect Cost (8% of Direct Cost) 1, 224 

TOTAL $16,524 

^8 of the 20 trainees will be local residents and will 
not require stipend support 

ST - Short Term 
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PROGRAM 4 

LOCAL CHANGE (LT) TRy ^ INING BUDG ET 
2/1/71 - H3\m 

Trainee Support 

6 Stipends @ $200 /month 
Dependency 

6 @ $500/yr. for .42 years 

Travel 

6 trips at $200 /trip 
Institutional Allowance 

6 @ $2, 500/yr. for .42 years 

TOTAL 



$ 6,000 

1,260 

1,200 

6, 300 

$14,760 



LT - Long Term 



jTiAINING ACTIVITIES 



Summary Training Costs 
2/1/71 - 1/31/72 

Program 

1. Curriculum Development ST Program 

2. Curriculum Development LT Program 

3. Local Change ST Program 

4. Local Change LT Program 

TOTAL 

ST - Short Term 
LT - Long Term 
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TOTAL TRAINING PROGRAM COSTS 
2/1/71 - 1/31/72 



Program Development, Administration & Evaluation $107,028 

Materials Development g4 Q^g 

Training Program 1 - Curriculum Development (ST) 11, 178 

Training Program 2 - Curriculum Development (LT) 14,760 

Training Program 3 - Local Change (ST) 16,524 

Training Program 4 - Local Change (LT) 14,760 

TOTAL PROGRAM COST toco no 
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PROJECTED OFFICE OF EDUCATION FUNDS 
2/1/71 - 1/31/74 



Classification 

Program Development, 
Administration & Eval. 

Materials Development 

Training Program 

TOTAL 



2/1/71 2/1/72 8/1/72 8/1 '73 

to to to to TOTAL 

1/31/72 7/31/72 7/31/73 7/31/74 

107,028 60,000 120,000 140,000 427,028 

94,068 44,000 80,000 40,000 258,068 

57,222 30,000 60,000 80,000 227,222 

258,318 134,000 260,000 260,000 912,318 
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LIST OF TASKS IN EDUCATIONAL R&D 



Introduction 

The following listing of educational R&D tasks Is meant to specify 
the units for which training components will be made available to use In 
training programs • No trainee will be taught to perform all of these tasks • 
However, It Is Intended that all of the tasks will be Involved In the 
training programs offered different categories of trainees • 

The list is divided according to eight areas of tasks: Development, 
Diffusion, Utilization, Evaluation, Research, Educational R&D Foundations, 
Social/Personal Competencies, and Project Management • 

The effort has been made to provide a comprehensive coverage of the 
essential activities Involved In educational R & D of any type and as con- 
ducted In any sort of agency. 

Building training components begins by listing the objectives (trainee 
behaviors) Involved In each task. Achievement sub-tests will be built to 
assess mastery of the objectives of the task. Then learning materials will 
be prepared for the task. The learning materials may Involve study guides, 
reading matter, programed lessons, laboratory simulation, or Internship 
experiences. 

Training programs for Individuals will be built by selecting those 
training components that match the tasks the trainee Is called upon to master. 



Rationale for the Content and Organization of the Task List and Work Flows 

The task list Is constructed on the assumption that the central tasks In 
Instructional Innovation are to be found In the areas of development, diffusion 
and utilization of Innovations, with the tasks In the remaining 5 areas 
(evaluation, research, R&D foundations, social/personal competencies, 
and project management) having Importance Insofar as they contribute to 
these three areas. 

The area of Development has been divided Into two Interacting but 
separable work flows. The first covers the development of school curricula 
or of training programs for educational personnel (which also require the 
development of curricula). Since school curricula and training programs 
require appropriate instructional environments for their implementation, 
the work flow for Instructional Environment systems is referenced at the 
relevant steps in the work flow for Development; Curriculum or Training 
Programs . 

The work flow for the instructional environment covers arrangements and 
procedures that link curricula (learning objectives, units, materials) with 
students. The instructional environment thus incorporates learning space 
and equipment, staffing, organization for instruction, teaching methods. 



reinforcement schedules, Interpersonal relationships, etc. The Instructional 
environment system should be explicitly designed In terms of the learning 
objectives of the curriculum It Implements as well as In terms of the charac- 
teristics of the student populations It serves* 

The two development work flows terminate with pilot testing and re- 
vision oc the Innovative product. At this point, assuming the product 
yields V(il.uable outcomes, diffusion becomes relevant* 

The area of product Diffusion has been divided into three sub-areas: 
Fi61d Testing ^ Demonstration , and Dissemination * The purposes of field 
testing are to try out the product in a variety of school settings, adapt 
it as needed to the requirements of each type of setting, provide materials 
and procedures (including staff training) for implementing it in the 
various contexts, and assess its outcomes in each of the several types 
of settings* 

If the field tests show the product to yield valuable outcomes in 
given types of schools. Demonstrations at selected sites become appro- 
priate* Demonstrations exhibit the product *s use in schools and can 
offer opportunltes for staff members of other schools to gain direct 
experience with the product and its implementation through workshops 
or internships held in a demonstration school. 

Dissemination consists of any means employed to communicate infor- 
mation about a product to potential users* The purpose shouldinot be 
seen as that of selling the product but rather of providing potential 
users with valid and adequate bases for deciding whether or not to adopt 
the product, and bases also for setting about to implement and assess it 
in the local setting* 

The task flow for Utilization takes account of innovations from the 
perspective of the consumer rather than the prod' cer. Here the proper 
starting points are the needs of the local school system or school* Avail- 
able Innovative (or pre-existing) products are then examined as they relate 
to meeting the designated needs* Local change programs then are designed 
and conducted to implement the products selected in ways that take account 
of the unique combinations of factors that apply to particular local settings* 

(An ambiguity in the development-diffusion-utilization categorization 
is that, in a general sense, the term "development** applies to all three 
categories* This is the case since one not only may develop innovative 
instructional products but also may develop diffusion strategies and 
programs, or develop local change programs* In the present categori- 
zation, the term development applies to the origination of innovations 
in instruction*) 

The task list for Evaluation is divid? ' ^nto three parts: Formative 
Evaluation , Summative Evaluation , and Test A^-^ valopment , Both formative 
and summative evaluation are very frequently referenced in the work flows 
for development, diffusion, and utilization since they are involved in 
assessing the design, implementation, and outcomes o^ programs in those 
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areas. Competencies in test development are vital in projects to develop 
curricula or training programs at*d so are referenced in the work flows 
for those areas. 

The task flow for Research relates to the task areas of development, 
diffusion, and utilization at those points where basic or applied research 
studies can contribute to the design of instructional innovations. In con- 
ducting "strategic" research that is intended to provide a basis for 
instructional innovation, the researcher selects a research problem that 
has direct relevance to instruction. (The study of Educational R&D 
Foundations provides the trainee with general bases for selecting strategic 
research problems.) 

The area of Social/Personal Competencies lists characteristics trainees 
should possess for effectiveness as workers and members of project teams in 
educational R&D agencies. It is not assumed that each item on the list 
will be treated as a training task since most of the competencies are very 
hard to establish by training. To a considerable extent, these characteristics 
will be sought in trainees at the time of selection. Thereafter, most of the 
relevant training will be provided by individualized guidance and counseling. 

The task list for Project Management covers the competencies that are 
required of managers of R & D programs, projects, or sub-projects. They con- 
cern project planning, budgeting and contracting, project staff, supervising 
project activities, and maintaining communication about the project. 
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DEVELOPMENT 

A. Curriculum or Training Programs 

1. Identify curriculum and training need 

2. Apply criteria of inportance and feasibility in deciding whether to develop/ 

3. Identify classes of terminal objectives that are of concern. For example: 

a. Specific knowledge 

b. Specific procedures 

c. General cognitive skills (e.g., problem solving, formulating questions) 

d. General social and personal skills (e.g., self-direction, cooperation) 

4. Specify terminal objectives using appropriate "experts" as sources of 
information. 

*5. Analyze terminal objectives :c determine common components, learning 
difficulties, prerequisite relations, etc. 



*6. Establish instructional sequences and units, 
including entering prerequisites for each. 

7. Prepare tests or observation schedules for 
each objective and/or sequence.^ 

*8. Formulate instructional strategies taking into 
acount: 

a. Behavior and learninc^ analyses of the 
objectives 

b. Instructional sequences available 
(people, media, etc . ) 

c. Interaction of subject matter, general 
cognitive and social goals 

d. Motivational and other charactertistics 
of students 



Can be performed 
simultaneously or 
-In any order. 



9. Prepare instructional materials including programed lessons, inquiry 
problems, simulation exercises, etc. 



:RJC 
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10. Test the instructional materials on a few members of the target 
I population. 

a 

11. Interpret test data and revise. 

*12. Identify or design educational environment and management necessary 
for implementation of curriculum.^ 

*12 . Prepare materials required for management — including manuals for 
teachers and other staff members.^ 

*14. Identify teacher behaviors necessary for implementing the curriculum. 

*15. Prepare teacher training materials and/or conduct training programs. 

d 

16. Design an evaluation program to assess implementation and outcomes. 

17. Arrange and conduct a pilot test under controlled conditions. 

d 

18. Interpret pilot test data. 

19. Revise curriculum. 

b 

20. Revise management system. 

c e 

21. Revise staff training system. 

22. Collect evaluation data and report on program charactertistics and 
effectiveness. 



a. Steps 10 and 11 should be repeated until the materials meet an 
appropriate criterion of acceptability. 

b. See work flov/ for Instructional Environment Systems. 

c. The present sequence of curriculum development can be applied to the 
design of teacher training materials, bep^lnning with Step 1. For a 
teacher training program, the **staff'* to be trained is the supervisor, 
course instructor, or other program administrator. 

d. See work flow for Evaluation. 

e. Steps 16-21 should be repeated until an appropriate criterion of 
acceptability is met. 



* Processes likely to generate research questions. For the activities 
involved, see work flow for Research. 
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B. Instructional Environment Systems 

!• Identify potential instructional environment desipn need. 

2, Apply criteria of importance and feasibility in deciding whether to 
develop,^ 

3, Identify classes of terminal objectives that are of concern. For example: 

a. Specific knowledge 

b. Specific procedures 

c. General cognitive skills (e.g., problem solving, formulating questions) 

d. General social and personal skills (e.g., self--direction, cooperation) 

4, Analyze existing and new information to produce a description of: 

a. Objectives to be met by the nev^ instructional environment 

b. Current constraints in terms of space, manpower, cost, etc. 

*5. For each objective in 4a, specify the kinds of environment(s) that are 
required, or might be expected, to meet th*: objective. Describe these 
environments in terms of: 

a. Curriculum content characteristics 

b. Curriculum management characteristics 

c. Reinforcement (motivational) characteristics 

d. Social characteristics 

e. Organizational arrangements 

*6. For each item in 5, specify alternate ways in which the requirement 
might be met, taking into account space, manpower, equipment, 
scheduling, personnel satisfaction, etc. 

7. Compare alternative in 6 with constraints in 4b. 

8. Select an approach (from 6) with minimum discrepancy. 

9. Determine necessary new facilities, staff, etc, and determine whether thev 
can be made available. 
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10. Prepare observation schedules or tests for assessing extent to which 
i.ritical characteristics of the environment system are being implemented J 

11. V.dentifv curriculum materials necessary for implementation of environment 
•system. 

12. Prepare manuals and other materials for implementing the new system. 
*13. Identify teacher behaviors necessary for implementation. 

*14. Prepare staff training materials.^ 

15. Design an evaluation program to assess implementation and outcomes.^ 

16. Arrange and conduct a pilot test under controlled conditions. 

17. Interjjret pilot test data.^ 

18. Revise environment system. 

19. Revise curriculum for implementing environment system.^ 

20. Revise staff training materials. 

21. Collect evaluation data and report on program characteristics and 
effectiveness. 

a. See work flow for Evaluation. 

b. See work flow for Curriculum and Training Programs. 

c. Steps 16-20 should be repeated until a criterion of acceptability for 
the total system has been met. 



* Processes likely to generate research questions. For the activities 
involved, ee work flow for Research. 



DIFFUSION 

A, Field Testing 

1. Select and describe the product that is to be field tested • 

2. Specify purposes to be served by the field test. 

3. Identify sub-populations of potential product users having common character- 
istics that might influence product effectiveness. 

a. Socio-economic class 

b. Cultural/ethnic/nationality characteristics of community 

c. School location factors (urban/suburban/rural) 

d. Previous experience of school staff with similar products 

4. Analyze the sub-populations to Identify modifications required in the 
product or specific requirements for implementing the product in 
different settings. 

5. Design needed product modifications. 

6. Create product modifications and try them on samples of the sub-populations. 

*7. Design implementation procedures appropriate to the sub~populations and/or 
changes required In the user agencies to implement the product (organiza- 
tional structure, staffing, uses of facilities, etc.). 

8. Develop the implementation procedures and make the required changes in user 
agencies. 

9. Develop a program for assessing product implementation and outcomes.^ 

10. Select a variety of settinj^s for try-out of the product that represent the 
major sub-populations of potential users. 

11. Secure cooperation of field test agencies representative of the sub-populations 

12. Design and implement needed training programs for personnel in the field test 
agencies. 

13. Conduct the field test. 

14. Employ field test data to modify the plan or its implementation. ^ 

15. Repeat the field test as the same or different sites representing the 
selected sub-populations. 

16. Collect, analyze, and report data on product implementation and outcomes 
in the various types of setting.^ 

17. Recommend modifications in the product to the developer or producer. 
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B. Demonstration 

1. Select and describe the product to be demonstrated. 

2. Identify sub-populations of potential users of the product and develop criteria 
for the types and locations of demonstrations, 

3. Select appropriate sites for the demonstration, considering such factors as: 

a. Validity of sites, i.e., degree to which they are representative of 
potential user settings 

b. Ar.»ticipated effects of a successful demonstration on potential users' 
decisions ^about adopting the product 

c. Evidence of cooperation from personnel at the sites considered 
c. Associated costs in staff, materials, time, etc. 

4. Plar. liaison and logistical operations for demonstration. 

5. Prepare implementation plan including provisions for training operational 
and administrative personnel.^ 

6. Design an assessment program to:^ 

a. Measure the effectiveness of implementation of the product 

b. Measure outcomes from implementing the product 

7. Make necessary contacts and agreements with individuals and agencies for 
securing demonstration sites. 

8. Train operational ancj administrative personnel.^ 

9. Implement the demonstration. 

10. Collect and analyze feedback data to identify needed modifications in the 
demonstration,^ 

11. Modify the demonstration plan as indicated by feedback data. 

12. Repeat the demonstration at the same or different sites. 

13. Analyze data on product effectiveness and communicate information concerning 
needed modification to the product's developer or producer.^ 
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Dissemination 

1. Identify the need for a dissemination effort relevant to a specific 
''.nstructional system/element.^ 

a. Define the user population 

b. Define the instructional system/element of concern 

c. Assess the extent of current use of the instructional system/element 
of concern 

d. Assess the extent of potential adoptions and use within the target 
population 

e. Describe and assess the potential effect of increased use of the system/ 
element (e^g., improvement in instructional methodology) 

2. Apply criteria of importance and ^*=' .ibility in deciding whether to conduct 
the dissemination effort.^ 

a. Assess the cost of the anticipat'id dissemination effort 

b. Assess the potential success of the anticipated dissemination effort 

(in terms of information content conveyed, number of anticipated adoptions, 
and net positive effect on instructional methodology) 

c. Decide whether or not to initiate development of a dissemination program 

3. Define the specific objectives of the dissemination effort ji 

a. Identify classes of " iformation tht target audience should acquire as a 
result of the dissemination effort 

(1) Characteristics of the instructional system/element 

(2) Potential educational benefits of the system/element 

(3) How the product differs from other products of the same type 

(4) How to adopt an' use the product 

(5) Logistical, adriinistrative, and cost factors involved in the system/ 
element's use 

b. Identify extent of target audience to be reached 

c. Identify time, cost, personnel limitations relevant to the anticipated 
dissemination effort 
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4. Identify the target population in t<** of characteristics that will be 
relevant to designing and administer l.ig the dissemination effort.^ 

a. Devise a system for the collection of information describing the target 
population such as: 

(1) Entering behavior with respect to objectives specified in 3 above 

(2) Anticipated resistance and/or interest in the system/element 

(3) Geographic location and degree of dispersion of the target group 

(4) Accessibility through prospective media (e.g., print, face-to-face 
contact, direct mail, etc.) 

(5) Degree of homogeneity/heterogeneity in the above descriptive factors 

b. Identify reliable sources jf valid descriptiv* data (factual, judgmental) 

c. Collect the descriptive data 

d. Analyze and interpret the data 

e. Describe the target audience in terms of the data acquired 

*5. Formulate a strategy for the dissemination effort, integrating information 
about the target population, product characteristics, communication channels, 
and vehicles. 

a. Identify the major elements of the dissemination effort whose goal is to 
maximize achievement of the dissemination objectives at a minimal cost 

(1) Select appropriate media 

(2) Conceptualize an appropriate message (i.e., information content, 
level of detail) 

(3) Define an information dissemination schedule (how, when, and where 
contacts will be made) 

b. PreHtct the general effect of the above elements 

c. Modify the elements as required 
6. Develop the dissemination materials 

a. Write, edit and revise copy 

b. Prepare illustrations 
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7. Develop instruments and procedures for evaluating the dissemination effort 

in terms of effectiveness of implementation and accomplishment of ohjectives.^ 

a. Develop a measurement system (e.g., descriptive dimensions, measurement 
instruments , etc . ) 

b. Establish criteria and standards of evaluation 

c. Develop data collection and analysis procedures 

d. Develop data interpretation and feedback procedures 

8. Pretest the prototype material on a small sample of the target population.^ 

a. Locate and contact a representative sample of the target population 

b. Administer material 

c. Utilize measurement system (collect, analyze, and interpret data measuring 
the effect of the pilot dissemination effort) 

d. Recommend modifications to the dissemination system based upon pretest 
results 

9. Revise the material on the basis of tryout results.^ 

a. Determine areas of dissemination effort where improvements appear to be 
required 

b. Determine type and extent of improvements required 

c. Assess cost and degree of improvement resulting from suggested modifications 

d. Make improvements which are cost/effective 

10. Implement the dissemination program with the target population. 

a. Manage preparation and dissemination of finalized materials 

b. Make last»minute alterations in materials, methods, etc.> which are required 

c. Implement dissemination evaluation procedures 

d. Respond to audience questions, adoption requests, criticisms, etc. 
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11. Assess the effectiveness of the dissemination program in terras of:^ 
a* Number of potential users reached 

b* Knowledge potential users gained about the product in terms of the 
objectives listed 

c* Evidence that the dissemination effort has influenced valid decisions 
to adopt or not to adopt the product 

d. Cost benefit analysis 

12* Revise the program in the light of evaluation results and repeat steps 10-11. 

13* Prepare report on the dissemination effort including recommendations to 
producers and marketers* 



a* See work flow for Evaluation. 

b. See work flow for Development: Curriculum or Training Programs. 



Processes likely to generate research questions. For the activities 
involved, see work flow for Research. 



UTILIZATION (LOCAL CHANGE PROGRAMS) 

1. Identify and define the objectives of the instructional system/sub-system/ 
elements of concern, 

2. Assess the degree to which the designated objectives are currently being 
achieved and identify the critical areas of shortcoming,^ 

3. Identify and assess the means (methods, products, services) available within 
the state of the art that could be used to remedy the identified shortcomings.^ 

*4. Develop a list of change programs that might be undertaken to remedy the 
shortcomings identified. 

5. Assess the short and long term costs associated with the available means 
for improving the accomplishment of the designated objectives,^ 

*&• Conduct a local resources survey to identify constraints associated with 
undertaking change programs intended to remove designated shortcomings.^ 

7. Rank order the potential change programs in terms of such dimensions as:^ 
a. Relative need for the changes involved 

b* Likelihood of program effectiveness 

c. Anticipated impact of the program on other components of the instructional 
system 

d. Difficulty of implementing the program 

e. Availability of needed resources for program implementation 
f • Support for the program within school and community 

8. Select the change program to be undertaken. 

9. Design the change program, specifying: 

a. Changes to be instituted in the instructional program 

b. Required changes in administrative/management producedures 

c. Support and service requirements 

d. Training required 

e. Program implementation procedures 

10. Design a program fo^ assessing program implementation and effectiveness.^ 



11. Obtain the resources required to conduct the change program from 
internal and/or external sources (approval, experitise, funds, etc.). 

12. Conduct pre-implementation activities: 

a. Preparation of materials, etc. 

b. Modifications in instructional arrangements 

c. Training of personrel 

13 • Implement the change program. 

lA. Collect and analyze feedback data, modifying the change program as 
indicated. 

13. Implement the modified program, gatheing assessment data on 
implementation and outcomes. 

16. Analyze data on program effectiveness and prepare a report with 

recommendations for continuing, extending, or abandoning the change 
program . 



a. See work flow for Evaluation. 



* Processes likely to generate research questions. For the 
activities involved, see work flow for research. 
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EVALUATION 
I. Formative 

A» Evaluate relevant context to identify ipajor problem areas. 

1. Identify present goals of system 

2. Assess value of goals 

3. Identify criteria and data to be used -in assessing goal achievement 

4. Assess current degree of goal achievement 

5. Identify problem area(s) to be the focus of immediate attention 

B. Evaluate inputs (goals and plans for their achieN^^ement) . 

6. Identify and clarify basic purposes of the given development 
effort in terms of: 

a. Clarity of statement 

b. Feasibility 

C. Potential value as solution to problems identified 

7. Delineate specific goals and evaluate them in terms of: 
a* Relationship to basic purposes 

b. Specificity of their statement 

c. Possibility of attainment 

8. Specify criteria to be used in eventual assessment of specific 
goals and evaluate them in terms of: 

a. Validity (including potential reliability) 

b. Feasibility 

9. Examine plans for achieving goals and evaluate them in terms of: 

a. Actual availability (Have plans been produced?) 

b. Specificity and clarity 

c. Potential for achieving goals (Are they based on any relevant 
research or on results from experience?) 

d. Usefulness (Can they be carried out?) 
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C. Evaluate processes (i.e., program operation). 
10» Assess degree of implementation of plans 

a. Develop procedures and techniques fo* monitoring extent of 
implementation 

b. Apply procedures and modify them as needed 

c. Carry out the monitoring activities 

'd. Channel feedback on operations to proper persons or agencies 

e. Clarify the implications of specific types of feedback 

11. Further monitor program implementation as initial feedback results 

in change 

12. Monitor restructuring of plans as this is indicated by feedback on 
operation 

D. Evaluate products (i.e., assess achievement of program goals)* 

13. Apply criteria and procedures for determining degree of achievement 
of goals 

a. At various stages of implementation to provide interim summative 
evaluation data 

b. Wicn development effort is completed (See Summative Evaluation) 
14 • Prepare evaluation reports. 

a. At intermediate stages 

b. As final summative assessment 
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II. Summatlve 

1. Specify the characteristics of the instructional system/sub-system/ 
element to be evaluated (see Formative Evaluation). 

2. Specify the purpose(s) of the evaluation effort and the uses to be 
made of the findings. 

3. Identify the dimensions of the system/element characteristics(s) 
be evaluated; for example: 

a. Effectiveness in attaining objectives 

b. Acceptability to users 

c. Compatibility with operational context 

A. Describe alternative means of data collection for each dimension of 
concern (for example, rational examination, observation, measurement). 

5. Identify and consider the variables that influence the selection of 
a data collection method. 

a. Availability of useful criteria and minimum standards 

b. Reliability and validity considerations 

c. Associated costs and time factors 

d. Availability of instruments or procedures 

e. Administrative resistance 

6. Select an appropriate data collection approach. 

7. Develop a procedure for analyzing, interpreting, and communicating 
evaluative data, findings, and recommendations. 

a. Acceptable criterion levels for dimensions of concern 

b. Diagnostic/analytic techniques 

c. Statistical operations 

d. Operations for converting findings into useful form 

8. Identify constraints, costs, technical limitations of procedure. 

9. Modify procedure in light of constraints, costs, and limitations identified 
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10# Plan evaluation study activities^ 
a« Staffing 
b« Staff training 

c« Liaison and logistical activities 
d« Work schedule 

!!• Carry out and coordinate required pre-study activities as in 10 above. 

12. Conduct evaluative data collection as identified in A above. 

13 • Analyze data by procedures developed in 7 above. 

Interpret findings and transform them into a format which satisfies the 
needs of the evaluation effort. 

15» Report findings and make specific recommendations re continuing, 

modifying, or terminating the instructional system/sub-system/element 
under consideration. 
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III. Test Devel o pment 

1. Define purpose and use of test. 

2. Prepare content and behavioral specifications of test. 

a. Analyze behaviors or construct to be tested to determine components 

b. Select general classes of content and behavior to be included 
on test 

c. Determine relative emphasis for general classes of content and 
behavior to be included on test 

3. Survey practical limitations for test use and administration and 
develop tentative plan for final integration of test into overall 
testing program. 

4. Develop scoring procedures. 

5. Determine ultimate test length and length of tryout versions. 

6. Plan for item construction (number and types of items required) in 
terms of personnel and resources. 

7. Develop test items, directions to examinees, directions for administering 
and scoring procedures. 

a. Construct preliminary versions 

b. Edit and review 

c. Prepare records for each item 

d. Revise items, directions, and scoring procedures on basis of review 

8. Plan tryout stages. 

a. Develop sampling plan 

b. Make administrative arrangements 

9. Tryout test and alternate forms. 
10. Analyze data to determine: 

a. Any mechanical difficulties in test taking and administration 

b. Actual time requirements 

c. Reliability and validity of tests 

d. Difficulty and/or discriminations of items 
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11. Recycle if data in Task 9 indicates need* 

12* Plan for and conduct equating and standardization studies if 
necessary* 

13. Design and reproduce final version of test (includes page size 

and layout, provisions for directions, and provisions for responses). 

14. Prepare technical report and test interpretation manual. 
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RESEARCH 

!• Select the research topic or area of interest and indicate the basic 
variables to be investigated. 

2, Locate, review, and critique previous theory and research related to the 
topic or area, 

3, Identify the situational factors tnat will limit the research activity 
(available personnel, facilities, time, etc.). 

4, Specify the research problem in terms of independent and dependent 
variables. 

5, Predict the functional relationships between independent and dependent 
variables. 

6, Plan a research approach suitable to the problem, considering dimensions 
such as: 

a. Data collection methodology 

b. Statistical design 

c. Number of observations and/or subjects required 

d. Logistical, technical, and cost limitations 

7, Assess the feasibility of the initial plan and modify it accordingly. 

8, Define the ind<>pendent and dependent variables in terms of the operations 
and measures to be used in the research environment. 

9, Identify the subject population, 

10. Specify the research design in terms of: 

a. Characteristics of data tq be acquired 

b. Data collection environment, procedures, apd schedules 

c» Control techniques (e.g., statistical, experimental, sampling) 

d. Anticipated data analysis procedures 

e. Anticipated personnel, time, funding, facilities, materials, and 
liaison requirements, 

11. Modify research design in light of reality constraints. 
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12. Plan to implement research design. 

a. Hiring and/or training research personnel 

b. Liaison and logistical activites 

c. Design and construction of required data collection instruments, methods 
devices • 

(I. Specify pre-study activities (e.g., pre-testing methods and materials) 

e. Set up milestone chart for completion of research activities 

f . Provide for use of alternative research approaches if problems are 
encountered 

13. Conduct pre-research activities* 

a. Train personnel 

b. Confirm operability. reliabi^ ' -y , and validity of data collection 
instruments and procedures 

c. Conduct liaison and logistical activites 

d. Revise research design and plan as required 

14. Implement research plan. 

15. Monitor research operations for anticipated difficulties. 

16. Make changes in research design, in data collection procedures, or in 
technical or administrative operations as required to overcome 
difficulties encountered. 

17. Complete data collection using original or revised plan. 

18. Transfer raw data into appropriate form for further processing. 

19. Implement statistical methods of data analysis. 

20. Depict findings with graphs, tables, and other appropriate presentations. 

21. Summarize, interpret, and report findings in a form appropriate to the 
intended audiences, including specialists in instructional development, 
diffusion, or utilization. 
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EDUCATIONAL R&D FOUND/iTIONS 

1. Define, distinguish, and interrelate educational development » diffusion, 
utilization, evaluation, and research. 

2. Describe functions, programs, and roles in these educational R&D agencies: 
research-and-developmetit centers, regional educational laboratories, state 
education departments, supplementary education centers, research-and-evaluation 
centers in school systems, and members of the education industry. 

3. Demonstrate competence in search skills required in locating information about 
educational R&D. 

4. Describe the "educational reform movement" in the United States during the 
period since 1955 in terms of major purposes underlying innovative programs, 
origins of major program thrusts, sources of funding, types of innovations 
brought fon>yard, and impact on instruction in schools. 

5. Describe instructional systems in terms of their major components. 

6. Compare and contrast two or more instructional systems in terms of how they 
represent each major component. 

7. Specify the requirements for building a programed instructional unit. 

8. Specify the requirements for instructional programs that represent each of 
the following related themes: individualization, mastery, and student self- 
direction. 

9. Compare and contrast two or more instructional systems in terms of how and 
to what degree they involve individualization, mastery, and student self- 
direction. 

10. Specify the instructional requirements for teachi- ^ inquiry (problem-solving 
thinking or creative production). 

11. Compare and contrast two or more currirula in terms of how and to what extent 
they are designed to teach inquiry; ditt for tuo or more instructional 
approaches. 

12. Describe school/community relationships as they impact on the design, conduct, 
and support of the instructional program; give particular attention to issues 
concerning Black/White relations in the inner city. 

13. State learning objectives of the following types in terms of student behaviors: 
reading, arithmetic skills, concepts, principles, problem-solving competencies, 
competencies in self-directed learning, competencies in self-evaluation, positiv£ 
self-concept, and values. 

. Demonstrate knowledge of learning theory (concept and principle learning; 
discrimination and generalization or transfer; motivation and reinforcement) 
in relation to instruction. 

15. Demonstrate knowledge of the relationships of basic (i ^damental) and applied 
research to the design of instruction. 

ERLC 
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SOCIAL/PERSONAL CO>fPETENCIES 
A. Interpersonal 

1. Express information and ideas effectively to co-workers at appropriate times. 

2. Request needed information or help from co-workers. 

3. Assist co-workers and accept assistance from them. 

4. Contribute ideas to group planning activities. 

5. Asses- one's competencies related to the group's work, and communicate 
these to the appropriate group members. 

6. Accept and perform differing roles in group according to work requirements. 

7. Contribute to maintenance of group's work flow. 

8. Contribute evaluation of group performance and offer suggestions for iFiproveinent . 

9. Contribute to positive interaction among group members. 
B. Work Habits/Attitudes 

10. Perform and complete work on schedule. 

11. Accept and assume responsibility for own work. 

12. Work independently. 

13. Subordinate personal interests to work requirements. 

a. Changes in job status when necessary 

b. Work schedules 

c. Regulations and supervision 

14. Maintain professional ethics in work activities. 

15. Show interest in work. 

a. Improving technical knowledge of proficiency 

b. Participation in professional organizations 
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PROJECT MANAGE>IENT 

A. Planning the Project 

1. State project objectives as products and processes. 

2. Select a planning technique appropriate to the scope and goals of the 
project* 

3. Diagram the flow of activities in PERT form.. 

4. Analyze work to estimate requirements^ for : 

a. Staff competencies 

b. Funding 

c. Time 

d. Facilities 

5. Define alternate sets of staff roles, and their related tables of organization. 

6. Identify and plan needed inter-actions with other projects and agencies. 

7. Prepare project plans which specify the inter-relations of elements 4 a-d 
above, establishing intermediate and final deadlines. 

8. Establish planning feedback mechanism. 

9. Periodically assess work flow. Budget, assignments, etc., to determine if 
the plan is vTorking. 

10. Revise plan or components as necessary. 

B. Budgeting and Contractin g 

11. Identify funding sources. 

12. Estimate direct/indirect project costs. 

13. Analyze project organization/funding for compliance to relevant f^^uideline.s. 

14. Prepare detailed budget. 

15 « Select a budgetary cost control system. 

16. Prepare formal contracts with funding . ^^encics and subcontractors* 

17. Procure necessary facilties, equipment and support services. 
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C. Building Manpower Resources 

18. Recruit and select staff to achieve a full set of staff roles as identified 
in 5 above. 

19. Orient staff to the project in terms of project goals, demands on staff, 
table of organization, project setting, personnel policies, etc. 

20. Assess staff members to determine training needs at the outset and as 
they develop. 

21. Select or design training experiences. 

22. Conduct formal/informal training for staff members as needed. 

23. Build working relations (contractual/informal) with necessary projects 
and agencies as identified in 6 above. 

Supervising Project Activites 

24. Make assignments appropriate to staff members* capabilities/interests. 

25. Delegate authority commensurate with responsibility/capability. 

26. Specify and maintain standards of quality/efficiency. 

27. Parcel work, with full specifications, to other projects and agencies. 

28. Adjust assignments to correct excessive/insur+'I/ient vnric loads. 

29. Provide appropriate reinforcement. 

30. Maintain accountability mechanism for expenditures and staff time. 

E. . Co raiuunicating Information 

31. Develop formal communication network within project and agency. 

32. Periodically report progress and accountability to administrators and 
funding agencies when necessary. 

33. Keep staff fully informed of decisions and their rationale. 

34. Develop effective liaison with groups/individuals interested in project 
goals and progress. 
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The following pages present in diagrammatic form a preliminary, partial, 
and illustrative analysis of tasks involved in developing and diffusing a 
curriculum. The purpose of this analysis is to identify the skills which 
are involved in the curriculum development process and which personnel who 
are to pa'^ticipate in the process must Stcquire* 

The particular type of analysis which was applied to the development 
process and that is here represented d iagrarnrat tcally is called "behavioral 
analysts." This type of analysis requires the identification of discrimi- 
nations, generalizations, and chains, three skills thought to be present in 
all types of performance. These skills are involved in varying combinations 
and to varying degrees in such diverse types of behaviors as: perceptual- 
motor performance, language, decision^making, following procedures, use of 
concepts and principles, etc. Because all these differing types of behavior 
can be analyzed for just three skills and for the same three skills, the 
ability to perform a behavioral analysis constitutes an ability general i zable 
to a broad range of performance tasks and knowledge domains. Because of this 
broad applicability, behavioral analysis represents a tool that can be used 
economically in dealing with the range of problems likely to occur in train- 
ing and in education. 

The techniques of behavior analysis have other advantages when used in 
developing curricula or in developing training programs. Once criterion 
performance, as stated in training or education objectives, have been ana- 
lyzed behavioral ly for the three component skills (discriminations, general- 
izations, or chains), many of the decisions about training or about education 
follow directly. One such key decision is to provide the learner the oppor- 
tunity to practice these very skills involved in the terminal performance. 
Having already identified the skills involved, decisions about training or 
education follow directly without the need for highly subjective and infer- 
ential leaps. 

The program being designed to train R, 0, 0, and E personnel will include 
instruction in the application of behavior analysis techniques to the develop- 
ment of curricula. In this project, the project staff itself is applying the 
very same techniques in analyzing procedures involved in developing a curriculum 
for R, D, 0, and E personnel. Thus, the project staff will therefore be 
recommending to R, 0, D, and E personnel, "Do as we do." 

i 



EXPLANATION OF DIAGRAMMATIC CONVENTIONS 



There is recent evidence suggesting that diagrammatic representations 
make learning more effective and efficient** There is every reason to 
suppose that if diagramming can be used as a learning aid^ it can also be 
used as a performance aid. And, indeed , one programmed course on instruc- 
tional technology has used diagramming techniques to facilitate the learning 
(and performance) of behavioral analysis techniques.** Similar diagrams are 
used in this report* An explanation of some of the diagramming conventions 
fol lows • 

All types of diagrams identify what are called inputs , actions, and 
outputs* 



INPUT ACTION OUTPUT 



STIMULUS 




RESPONSE 


► 


RESPONSE 
PRODUCED 

STIMULUS 


► 





"Inputs*' and ^'outputs** are used to refer to what psychologists call 
stimuli or stimulus situations. "Actions" refer to responses. The differ- 
ence between input and output consists primarily in "outputs" being stimulus 
conditions produced by the response a person has made. Inputs are an initial 
set of conditions that become the occasion for a response yet to be made. 
The diagram that follows illustrates a bit of a teacher's behavior. 



INPUT 




ACTION 




OUTPUT 


Student essay 




Reads , 

evaluates, and 
grades essay 


^ 


Letter grade 
on essay 
paper 


— ► 





noun phrase verb noun phrase 



*Gropper, G. L. The design of stimulus materials in response-oriented programs. 
Audio-Visual Communication Review , 1970, (2), 129-159. 

Horn, R. E., Nicol, E. H. , Kleinman, J. C. , S Grace, M. G. Information mapping 
for learning and reference . Cambridge, Mass.: Information Resources, Inc., 
T959: 

**Gropper, G. L. , S Short, J. G. Design of a training development system : 
A handbook. Pittsburgh: American Institutes for Research, 1969. 
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^ 'Mnputs/* always expressed as a noun phrase, consist of a set of condi- 

tions (physical or psychological) which become the occasion for an action to 

I be taken, ''Actions/* always expressed as a verb, consist of the behaviors 

or responses exhibited. **Outputs," always expressed as a noun phrase, con- 

I si St of a set of conditions (physical or psychological) produced by the 

action taken. 

I Diagrams consisting of spatially ordered rectanales can be used to 

represent inputs, actions, and outputs involved in all three skills: dis- 
criminations, generalizations, and chains. Discriminations, generalizations, 
and chains, however, are each uniquely represented by different types of 

* diagrams.* The differences are illustrated on the following page. 



^The potential uses of diagrams do not stop with their use in aiding the 
curriculum developer to analyze his subject matter and to develop strategies 
for teaching it. The diagrms themselves can also be presented to the stu^ 
dent or trainee to aid his acquisition^ retention, and transfer of the skills 
involved in terminal perfomance. Thus, for example, the diagrans presented 
in this volume can be considered as a job aid for the project staff in 
designing a curriculum for R, D, D, and E personnel. In the actual presen- 
tation of the curriculum to R, D, D, and E trainees, the very same dtagrams 
can be used by the trainees as a learning aid. 
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Most types of performance involve a 
large number of sequentially ordered 
sets of I NPUT-ACT I ON-OUTPUT relation- 
ships* The diagram at the right 
illustrates, through the use of long, 
connecting arrows , how an output 
becomes the input for the next action 
in the chain. For example, the output 
In square #3 becomes input Ifk for the 
next part of the chain* 



At any point in a chain, the performer 
has to be able to identify alternative 
input conditions* He has to identify 
an input from one of several possible 
inputs in order to be able to take 
alternative courses of action* Thus, 
a driver has to discriminate between 
red and green traffic lights (the 
alternative inputs) if he is to 
properly stop the car or to continue 
driving. Each input cell can be 
broken '^own, as in the diagram to the 
right, »nto alternative input condi- 
tions, la, lb, etc., which the per- 
former has to differentiate or 
discriminate. 



Sometimes when there are alternative 
input conditions to be discriminated 
or differentiated, each alternative 
may consist of a class of input con- 
ditions which have to be treated the 
same way. For example, the teacher 
has to discriminate between the 
classes, **boys*^ and ''girls** (e*g.. 
In order to make sure they use the 
proper toilet facilities)* She also 
has to generalize (i«e«, Identify 
all boys as boys and all girls as 
girls, which may be more difficult 
these days due to adoption of similar 
clothing and hair styles), in the 
diagram to the right, cell la In the 
above diagram is broken down into 
varied members belonging to the same 
class* 



The following pages contain a diagrammed overview of the development 
process (represented as a summary procedural chain) and some illustrative 
breakdowns showing an identification of more detail in the chains and an 
identification of the component discriminations and generalizations. 

This type of analysis will be completed for the entire curriculum 
development process and will form the basis for the design of procedures 
for providing training in curriculum development. The same type of analysis, 
although completed in less detail during the design phase, will be applied 
to other R, D» 0, and E functions. 
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SUMMARY OIAGKAM 
rOR LNTIRC PKOCCOURAL CHAIK' 



STEP \ 



INPUT 


ACTION 




OUTPUT 


Potential need for 
educat ional 
devcl opmcnt 




Formulate statement 
of need on tUe 
basis of avai labic 
inf ormat ion 

2 


^ 


Descr i pt i on 
of potential 
development need 


act i vi ty 

I 








3 













STEP 2 


Descr i pt i on 
of ootent iai 
deve I opment ' *-ed 




Apply cri teria of 
importance and 
feasibi 1 ity in 
deciding wl^ether 
or not to develop 




Yes /no decision 






► 












5 




6 



STEP 3 



STEP ^ 



Development task 
to pursue 



Idcnt i f i cz.< on of 
classes of 
prescribed terminal 
.performance 



10 



Ident i fy daises of 
termi na 1 performance 
to be brought about 
or '.maintained 



Determine kind of 
information neces" 
sary to specify 
terninal perfo rman cc 



Ident i f icatif^ri 
of classes of 
terminal performar.ee 



Ident i f i cat ion of 
exist ing and 
required i nfornwit ifiri 



I? 



STEP 5 



a. Need for 


1 


informat ion 


to 


be reviewed 




b. Need for 




i nf ormat i on 


to 


be collected 






13 



Ana I yze ex i St i ng 
i nf ormat i on 



Col lect and analyze 
new i nformat ion 



Task description:^ 
behav iora I 
spoci f icat ion of 
object 1 ves 



STEP 6 



Raw data col 1 ected 




Perform behavioral 


Step 5 and/or 




or other typo of 


task descript ion 


► 


task analysis 


16 




17 



Behav i ora I ana I ys i s 
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SUMMARY DIAGRAM 
FOR ENTIRE PROCEDURAL CHAIN 



STEP 7 



INPUT 




ACTION 




OUTPUT 


Behavioral analysis 




Review component 
behaviors and 
formally identify 


► 


Identi f ication 
of further, 
more detai led 




► 


requi red entering 
behavior 




prerequi si te 
behaviors 


19 




2C 




21 



STEP 8 


Behavioral analysis 
at appropriate 
level of detai 1 




Perform learning 
analysis 


► 


Identi f Ication 
of learning 
difficulties, 
common components, 
etc, 

2i* 




22 


► 


23 





Results of: 
behavioral analysis 
+ 

learning analysis 
25 




Making chunking 
and sequencing 
decis ions 

26 


► 


Decisions about 
size and content of 
learning uni ts and 
about sequences in 
which units should 
be presented 


► 





STEP 10 



Learning units 




Develop criterion 




Cri ter Ion 


+ 




performance tests 




performance tests 


task descriptions 










from Step 5 











(statements of 


► 








object i ves) 










28 




29 




30 



ei ther 
order 



STEP n 



LearnI ng unl ts + 
sequences + Identifi- 
cation of learning 
difficulties + 




Formulate 
instruct ional 
strategies 


> 


Description of 
instructional 
str». tegles for 


common components + 
objectives + tests 


► 




each unit 


31 
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FOR ENTIRE PROCEDURAL CHAIN 
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ACTION 



OUTPUT 
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STEP 12 



Description of 
instructional 
strategies for each 




Prepare materials 
and procedures 


► 


Instructional 
materials 


unit in sequeice 


► 








3^ 
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STEP 13* 



Units of 
instruct ional 
material completed 



37 



STEP l^** 



Tryout results 



STEP 15 



Revised 

instructional 

materials 



^♦3 



STEP 16 



Plans for field 
testing 



k6 



Conduct informal 
try outs 



38 



Tryout resu'.s 



39 



Interpret data and 
make appropriate 
revisions 



Revised 




instructional 




materials 






k2 



Make technical 
and administrative 
decisions and plans 
about field testing 



Plans for field 
testing 



^♦5 



Implement field 
test 



^♦7 



Field test data 



48 



*Steps 13 and I'* should be repeated until materials meet appropri^t*: cr'n*tr\*su 
of acceptabi 1 i ty 



EMC 



I 



from 



step 


1 


' cell 




1 page 

1 


I 



I 



I STEP 1 



NO DETAILED ANALYSIS PROVIDED* 



INPUT 


ACTION 


OUTPUT 


Potential need for 




Formulate statement 




Description of 


educational 




of need on the 




potential develop- 


development 




basis of avai lable 




ment need 


activity 


► 


information 






1 




2 




3 



I 
I 



from 



step 


2 


cell 






1 



erJcI 



NO DETAILED ANALYSIS PROVIDED* 



STEP 2 



INPUT 




ACTION 




OUTPUT 


Oescri ption of 
potential develop- 
ment need 




Apply criteria of 
importance and 
feasibility in 


► 


Yes/no decision 




► 


deciding whether or 
not to develop 

5 




6 



I 



from 



I 

I 

I 



step 


3 


(iHI 




j paqn 


1 



1 



STEP 3 



DETAILED ANALYSIS FOR 



INPUT 




ACTION 




OUTPUT 


Development task 
to pursue 




Identify classes of 
terminal performance 
to be brought about 
or maintained 


► 


Id^ tification 
of classes of 
terrlnal performance 




— ► 






7 




8 







ON NEXT 1 PAGE 



from 



step 


3 


cell 




1 Pdqe 


1 



MORE DETAILED 
DIAGRAM FOR CHAINS 



in any 
order 


INPUT 




ACTION 




OUTPUT 


UB-STEP 
1 


Development task 
to pursue 




Decide whether 
terminal performance 
includes "subject 
matter content" 


► 


Yes /no decision 
to teach classes 
of subject matter 
content 






► 






« 
1 




ii 




i i i 



JUB-STEP 
2 


Development task 
to pursue 




Decide whether 
terminal performance 
includes "general 
cognitive skills*' 


► 


Yes/no decision 
to teach or to 
maintain classes of 
general cognitive 






► 




skills 






i V 




V 






vi 

















SUB-STEP 
3 



Development task 
to pursue 




Decide whether 
terminal performance 
includes "social 
behaviors" 


► 


Yes/no decision 
to teach or to 
maintain classes 
of social behaviors 


• • 

VI 1 


■ ► 


VM i 






ix 















LIST OF FOLD-OUT PAGES 



page 13 
31 
57 
71 
79 
89 
101 
177 



ERIC 



1 



from 



step 


k 


cell 




page 


I 



DETAILED ANALYSIS FOR 



STEP i» 



INPUT 




ACTION 




OUTPUT 


Identification 
of classes of 
prescribed terminal 
performance 


► 


Determine kind of 
information neces- 
sary to specify 




Identification of 

existing and 

requi red information 




terminal performance 


^ 




10 








12 



ON NEXT 16 PAGES 



FOLD OUT 
THIS PAGE. 



ERIC 



13 



from 



step 


k 


cell 




page 


1 



MORE DETAILED 
DIAGRAM FOR CHAINS 





INPUT 




ACTION 




OUTPUT 


SUB- STEP 
4.1 


Development task 
to pursue 




Identify target 
aua lence 




Identification of 
age/grade level 
of audlenrp 




1 




ii 





















J 
















SUB-STEP 


Ident I f IcAt Inn rkf 

target audience 
* 

classes of 

terminal performance 

Iv 


► 


Identify appropriate 
sources of 
information 




Identification of 
appropriate sources 
of information 


i 




V 


► 




vl 


























SUB-STEP 


Identification of 
sources of 
information 


► 


Assess adequacy of 
Information sources 




Decision to use 
sources 










► 


















ix 











SUB- STEP 
4. A 



Decision to use 
sources 


► 


Identify type of 
information needed 




Identification of 
type of information 
needed 








► 






X 




xl 





















ERIC 



14 



from 



step 


A. 2 


roll 









DETAILED ANALYSIS FOR 



SUB-STEP 





INPUT 




ACTION 




OUTPUT 




Identification of 
target audience 

classes of 

terminal performance 

i V 


^ 


Identify appropriate 
sources of 
information 




Identification of 
appropriate sources 
of information 






V 




vf 



ON NEXT 5 PAGES 



ERIC 



17 



from 



■ 

step 


k.2 


(Hi 









MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



Curriculum involves 
knowledge domain 

(See page 21 
for relevant 
generalizations) 

i v.a 


► 


Identify subject- 
matter expert 
appropriate to 
target audience 

v.a 




identification of 
potential source 
of description of 
desired terminal 
performance in 
knowledge domain 

vl.a 




► 



Curriculum involves 
performance 

(See page 22 
for relevant 
genera li za tiona ) 

i V. b 




Identify expert 
performer of task 
or performance 
expert 

v.b 




Identification of 
potential source 
of description of 
desired terminal 
performance 

vi b 


► 


► 



Curriculum involves 
general cognitive 
skills 

(See page 22 
for relevant 
genera li zations )\y.c 



Identify expert In 
cognitive ski 1 Is 
(appropriate to 
target audience) 

v.c 




Identification of 
potential source 
of description of 
desired terminal 
performance 

vi .c 


► 



Curriculum involves 
social behavior 

(See page 24 
for relevant 
generalizations) 

Iv.d 


► 


Identify expert 
in developmental 
problems 




Identification of 
potential source 
of descr ipt Ion of 
desired terminal 
performance 

vi.d 




► 



I 



from 



step 


A. 2 


cell 


i V. a 


page 


18 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



KNOWLEDGE DOMAINS 
INPUT 



Physical sciences 



tv.a* 1 



Social sciences 



iv*a«2 



Humanities 



iv*a*3 



Biological sciences 



iv.a. A 



Mathematics 



iv*a*5 



ACTION 



OUTPUT 



Identify subject- 
matter expert 



Ytfl 



Identification of 
potential source of 
information about 
terminal performance 
in knowledge domain 

yi 



19 



'i8 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INr'UT 



Performance Areas 

Procedural tasks 
in pHys i ca I » 
b iological , or 
social sciences 

i v.b. I 



Procedural tasks 
in mathematics 



iv«b«2 



ACTUM 



OUTPUT 



Reading, writing 



fv.b,3 





Identify expert 
performer of task 
or performance 
expert 




Identification of 
potential source 
of information of 
desired ternHnat 
performance 

vi.b 


— ► 


► 



Procedural tasks 
in humanities: 
e.g. y acting, 
painting, writing 
(poetry, essays) 




Etc. 






i v.b.n 



20 



MORE OETAilEO 
DIAGRAM FOR GENERALIZATIONS 

ACTION OUTPUT 



General Cognitive 




Skills 




Creativity 




i v.c. 1 





Problem^sol ving 



Uom 

18 



INPUT 



I V.C. 2 





Identify expert In 
genera) cogni tlve 
ski 1 1s appropriate 
to target population 

v.c 


► 


Identification of 
potential source 
of Information 

V i .c 


— ^ 





lYtC.'t 



Etc. 






iv.c.n 



MORE OETAiLEO 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



Social Behavior 



Independence 



Iv.dJ 



Cooperation in 
problem-solving 



iv.d.2 



Paying attention 



iv.d.3 



ACTION 



OUTPUT 



— 


identi fy expert 
in developmental 
problems 

v.d 




identification of 
potent iai source 
of informat ion 

vi.d 




► 



Goal-sctt inr 



iv.d.it 



ERIC 



Etc. 






!v*d*n 



22 



i 



from 



]i4 



DETAILED ANALYSIS FOR 



U4PUT 



identification 
'f sources of 
/^format ion 



ACT ION 



Assess adequacy of 
information sources 



vn I 



OUTPUT 



Decision to use 
sources 



ON NEXT 3 PAGES 



ERIC 



23 



from 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



NPUT 



ACTION 



Output 



Expert in 




Accept as source 


knowledge domain , 




of information 


in general 


^ 




cognitive ski 11$, or 






in social behavior 






vi i .a 




viii.a 



Ident i f i cat ion of 
acceptable data 
source 



ix.a 



Area in which 
acceptable model 
of performance is 
aval lable 




Accept as source 
of informat ion 
describing terminal 
performance 




Identification of 
appropriate data 
source 


► 


► 




(See page 27) 

vi i .b 




vi i i .b 




ix.b 



Performance area 
in which acceptable 
model is not 
avai lable* 

(See page 28} 

V i i . c 



Identify theory 
or hypotheses as 
sources for 
description of 
acceptable model 



vi i i .c 



Identification of 
acceptable data 
source 



IX. c 



*0r uncertainty exists as to its acceptability. 



I 



ffofn 



ERLC 



^.3 



ACCEPTABLE MODEL 

IS AVAILABLE* 

INPUT 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



ACTION 



OUTPUT 



Resf^arch procedures 
in physical or 
social science 



vi i .b. 1 



Vocational 
performance 
(automat ive, 
electrical, etc.) 

vii.b.2 



Other performance 
areas where there 
is evidence that 
performance as now 
exhibited meets 
standards of 
accompi ishment 



Accept as a source 
of information 
describing terminal 
performance 

viii,b 



Identification of 
acceptable data 
source 



ix.b 



^Acceptability of a model is a function both of the 
reliability of knowledge of what makes for effective 
performance and of the reliability of an informant's 
ability to convey that knowledge to others. 



25 



front 

— I 



^.3 



ACCEPTABLE MODEL 
IS NOT AVAILABLE* 

INPUT 



MORF DETAILED 
DIAGRAM FOR GENERALIZATIONS 



ACTION 



OUTPUT 



Teacher performance 



vii.c.) 



Counselor 
performance 



vii.c. 2 



Creative 
performance In 
humanities or in 
sciences 



viiiCtl 



Other areas ^n 

which acceptable 

model is unavai 1- 

able or it Is 

uncertain whether 

the model is 

acceptable . • 

^ vll.c.n 



identify theory or 
hypotheses as 
sources for 
description of 
acceptable model 

vir i.c 



identification of 
acceptable data 
source 



Ix.c 



*Acceptabl 1 ity of a model Is a function both of the 
reliability of' knowledge of what makes for effective 
performance and of the re U ability of an Informant^ 
ablUty-to convey that knowledge to others* 



26 



I 
I 



from 



.1.. 



_.JL. 



DETAILED ANALYSIS FOR 



INPUT 




ACTION 




OUTPUT 


Decision to use 
sources 


► 


Identi fy type of 
Information needed 


! 


Identification of 
type of information 
needed 


X 




xi 




xii 



ON NEXT 2 PAGES 



27 



frofn 

i 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 



ACTION 



Expert in subject 
matter, general 
cognitive skills, or 
social behavior as 
informant 

x.a 



Plan to solicit his 
judgments about 
what should be 
terminal perfo 



rmancc — 



xi .a 



Output 



Plans for obtaining 
description of 
terminal 
performance 

xi i *a 



Performance experts 
(acceptable model) 
as informant 

(See page 31) 


► 


Plan to sol icit 
information about 
or make observations 
of terminal 
performance 

xi .b 




Plans for obtaining 
description of 
terminal 
performance 

xi i .b 








Performance area 

(non-acceptable 

model) 




Plan to generate 
performance requ i re- 
ments from theory* 




Pians for obtaining 
description of 
terminal 
performance 




► 




► 


x.c 




xi .c 







*UltimateIy, to be validated by research. 



ffOfn 



28 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 



AC T \ 0U 



0 jlPljT 



PERFORMANCE EXPERT 
ACCEPTABLE MODEL 

Expert can reliably 
describe his own 
performance 

x.b.l 



Plan to col lect 
interview data 
about pe r f ormance 

xi .b. I 



Plans for collect icn 
of data 



xi i.b.l 



Expert cannot 
reliably describe 
critical eleftients 
in his per formcnce 



x.b.2 



Plan to make 




observations 


of 


performanca 






xi .b.2 



r 



Plans for collection 
of data 



xi i .5.2 






FOLD BACK 
PAGF. 13. 



ERIC 



30 



ffom 



STEP 



INPUT 



DETAILED ANALYSIS FOR 
ACTION 



a* Need for 

information to 
be reviewed 

b. Need for 

information to 
be col lected 


^ 


Analyze exist ing 
information 


Collect and analyze 
new informat ion 

lA 





rpiiT 



Task description: 
behav ioral 
specification of 
object Ives 



15 



ON NEXT 25 PAGES 



FOLD OUT 
THIS PAGE. 



from 



i 


1 

5 j 






1 



MORE DETAILED 

DIAGRAM FOR CHAINS 



INPUT 



SUB- STEP 
5. I 



identification 


of 


types of infoHMt lor 


to be reviewed 


or 


col lected 








Identification 


of 




i 



ACTION 

Develop data col lec- 
tion techniques 
appropriate to: (a) 
type of subsequent 
analysis to be made; 
and (b) data sources 
Li 



OUTPUT 

Preliminary form of 
data col lect ion 
techniques (may 
i nc I ude 1 n f orma t i on 
relevant to subse- 
quent analyses)* 

LU 



SUB-STEP 
5-2 



SUB-STEP 
5-3 



Prel imtnary form 
of data col lection 
techniques 


^ 


Try out forms on 
sample of informants^ 
observers, or infor- 
mation abstracters 




Final form of 
data collection 
techniques 






and revise forms as 
necessary 


► 








V 




vi 










1 


u 










Final data 
col lection forms 
"f 

Sources of 


► 


Col lect data 




Raw data (and/or 
partially analyzed 
data)* 


information 






► 




vii 




viii 




ix 



SUB-STEP 



Raw data (and/or 
partial ly analyzed 
data) 



Analyze and 
categorize data 



x! 



Task descriptions 



_21L 



SUB-STEP 
5.5 




Tasl< descrlptto- 


1 


Restate taslcs as 
objectives 




Statement of 
objectives, Includ- 
ing standards of 




► 







performance 


xiii 




xiv 




XV 1 



^ToBk analysia may be performed ae data are collented^ or it may be performed 
after objectives are formulated. 



I 



32 



DETAIieO ANALYSIS FOR 



ISPUT 



AC ' I X 



-'.TLJ^ S.I 



Idcnt i f i cat ton of 
types of information 
to be reviewed or 
col lected 

Idcnt i fi cat ion of 
data sources [ 



Develop data collec- 
tion techniques 
appropriate to: (a) 
type of subsequent 
analys is to be made; 
and (b) data sources 



Preliminary form of 
data col I 'set ion 
tecHn iques (may 
include informat ion 
relevant to subse- 
quent analyses)* 

ILL 



ON NEXT 7 PAGES 



from 



step 


5.1 


cell 


i 


P««ge 


32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 0) 



INPUT 




ACTION 




OUTPUT 


Observational data 
requi rement 


► 


Develop observation 
forms and procedures 




System for col lect- 
ing observations 








► 




l.a 




ii.a 




iii.a 



Verbal report data 
requi rement 




Develop intervi^ 
or quest ionnai re 
forms and procedures 




System for collect- 
ing verbal reports 




► 




► 




i.b 




ii.b 




iii.b 



Printed data 
requi rement s 






Develop search and 
abstracting forms 
and procedures 




System for collect* 
Ing data from 
existing documents 






► 




► 






I.C 




ii.c 




ni .c 



Theory requirements 





Hake plans to 
inspect "theory'' 
for def ini tlon of 
te rmi na 1 pe r f ormartoe 




Plans to define 
performance on 
basis of theory 










l.d 




li.d 




iii.d 





3'» 



I 

f 



from 



step 


5.1 




i 


1 P'igr' 


32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT 



ACTION 



OUTPUT 



Plans to perform 
behavioral analysis 
of terminal perfor- 
mance (See pages 36 
and 37 for relevant 
general izations) 

i .a 




Develop data collec- 
tion Jnstruments or 
procedures that will 
identify discrimina- 
tions, general iza- 
tions, and chains 

i ! .a 


► 


Data col lection 
instruments 
appropriate to a 
behavioral analysis 
approach to task 
analysis 

• • • 
1 1 1 .a 


► 





CTIONAL 



POTIONAL 




1p 



Plans to use other 
taxonomies in 
summarizing 
col lected data 




Develop instruments 
capable of producing 
appropriate infor- 
mation 


► 


Data col lection 
Instruments 
appropriate to 
analysis based on 


► 






other taxonomies 


i.b 




ii.b 




iii.b 


+ 




+ 




+ 



Plans to identify 
performance or 
learning difficul- 
ties relevant to 
taxonomy to be used 

i .c 



+ 



Develop data 
col lection instru- 
ments to identify 
difficulties experi 
enced in the past on 
1 ikely to be 
experienced 



ii.C 



Data col lection 
instruments 
appropriate to 
analysis performance 
or learning 
difficulties ... 

M I .C 



+ 



+ 



Plans to identify 
ways to overcome 
performance or 
learning difficul- 
ties 

i.d 




Develop data collec- 
tion Instruments to 
identify v/ays to 
overcome difficul- 
ties (e.g. , tech- 
niques used by 
informants that ^ 
have worked) i ! .d 


► 


Data col lection 
instruments 
appropriate to 
identification of 
ways to overcome 
difficulties 

i i i .d 


► 




















► 




^ 





35 



from 



step 


5.1 


cell 


i.a* 


page 


35 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 0) 



INPUT 



ACTION 



OUTPUT 



Terminal behavior 

involves 

PERFORMANCE 



i .a. 1 



Terminal behavior 
involves KNOWLEDGE 
DOMAIN 



i.a. 2 



Terminal behavior 
involves GENERAL 
COGNITIVE SKILLS 



i .a. 3 



Terminal 


behavior 


Involves 


SOCIAL 


BEHAVIOR 






i .a. 4 



Develop data collec- 




Data col lection 


tion instruments 




instruments appro- 


that wi 1 1 provide 




priate to a 


behavioral analysis 




behavioral analysis 


informat iun 


► 


approach to task 






analysis 


i i .a 




« • • 

t M •a 



^Diagram above also appropriate for cells i.b, 

i. c, and i.d and the associated action cells 

ii. b, ii.Cf and ii.d on page 35 » 



ERIC 



36 



from 



step 



cell 



page 



5.1 



35 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS (2) 



INPUT 



ACTION 



OUTPUT 



Informat ion 


about 


PERFORMANCE 


to be 


co) lected 









Information about 
KNOWLEDGE DOMAIN 
to be col lected 



i,a,2 



Information about 
GENERAL COGNITIVE 
SKILLS to be 
col lected 



Information about 
SOCIAL BEHAVIOR 
to be col lected 



I .a. 



Develop quest ions 
to identify inputs, 
actions, and outputs 



M .a 



Questions that can 
identify conditions 
unde^" which actions 
are taken and stan- 
dards for acceptable 
outputs 

i i i .a 



37 



from 



step 


5.1 


((HI 
1 l>'«l<* 


i 

32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (3) 



1 


INPUT 




ACTION 




OUTPUT 


1 


Terminal performance 
involves a serial 
flow of activities 




Develop questions 
that permit the 
description of 
activities in the 


► 


Questions that can 
lead to data which 
describe the flow 
of activities 






► 


order in which they 








i .a 




occur 

• • 

1 1 .a 




• • • _ 
M 1 .a 



Terminal 


performance 


involves 


a non- 


serial set of 


discrete 


activities 




i.b 



Develop questions 
that group (con- 
ceptual ly) related 
activities 



i i .b 



Questions that can 
lead to data 
grouped for con- 
venient, further 
analys is 

i i i «b 





ERIC 




from 



step 


5.! 


cell 


i.a 


pdge 


39 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



Information 


about 


PERFORMANCE 


to be 


col lected 






i .a. 1 



Information aboMt 
GENERAL COGNITIVE 
SKILLS to be 
col lected 

i.a.2 



Information about 
SOCIAL BEHAVIOR 
to be col lected 



i,a,3 



Develop questions 
that permit the 
description of 
activities in the 
order in which they 
occur 

ii.a 



Questions that can 
lead to data which 
describe the flow 
of activities 



M I «a 



erJc 



40 



from 



t.f'll 


5.1 
i.b 


1 page 


39 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



ERIC 



I 
I 

I 



INPUT 



Information about 
KNOWLEDGE DOMAIN 
to be col lected 



i.b.l 



E*g. , sciences 



i.b. 2 



E.g. t human 1 1 i es 



ACTION 



Develop questions 
that group (con- 
ceptually) related 
activities 



i i .b 



41 



OUTPUT 



Questions that can 
lead to data 
grouped for con- 
^vcnient, further 
analysis 

M I .b 



from 



step 


5.2 


cell 




1 page 


32 



NO DETAILED ANALYSIS PROVIDED 



INPUT 




ACTION 




OUTPUT 


Prel i mi nary form 
of data collection 
techniques 




Try out forms on 
sample of infor- 
mants, observers, 
or information 


^ 


Final form of 
data col lection 
techniques 


iv 


^ 


abstracters and 
revise forms as 
necessary >L 




vi 



from 



step 


5.3 


cell 




1 P»»<H? 


32 



DETAILED ANALYSIS FOR 





INPUT 




ACTION 




OUTPUT 


5.3 


Final data 
collection fontis 
+ 

Sources of 
information 

vi i 




Collect data 


► 


Raw data (and/or 
partially analyzed 
data) 


► 


• • • 

VI 1 1 




ix 



ON NEXT I PAGE 




from 



step 


5.3 






vi i 


MORE DETAILED 




32 


DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


Judgment by analyst 
and/or informant 
that learners have 
ski 1 1s at lower 




Collect information 
about ski 1 Is at 
level X 


► 


Information In 
detail at level X 


level — but not at 
level X 

vi i .a 


► 


vi i i «>a 




ix.a 



Judgment by analyst 
and/or informant 
that learners do 
not have skills at 
level X and levels 
below 

vii.b 




Collect information 
in more detai 1 
(I.e., breakdown of 
chains into compo* 
nents) down to level 
at which learners 
can perform vi i i .b 





Information down to 
level Y (at which 
learners can 
perform) 

Y = lower level of 
analysis than for X 
ix.b 










ERIC; 




I 

I 



from 



step 


5.^ 


cell 




j page 


32 



INPUT 



DETAILED ANALYSIS FOR 

ACTION 



OUTPUT 



SUB-STEP 





Raw data (and/or 




Analyze and 






partially analyzed 




categorize data 




5.^ 


data) 








X 


1^ 


xi 





Task descriptions 



xii 



ON NEXT 2 PAGES 




from 



step 


5-^ 


cett 


X 


page 


32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (i) 



INPUT ACTION OUTPUT 



Behavioral analys is 
data at level of 
detai 1 at which 
col lected 

x.a 


► 


Create and describe 
task unit consist- 
ing of each input/ 
action/output 

xi .a 




Description of an 
individual task 

xi i .a 




► 



Non*ana1yzed data 


>• 


Create and describe 
task unit at level 
Judged useful for 
subsequent treat- 




Description of an 
individual task 






ment 


^ 




' x.b 




xi .b 




xi i .b 







50 



from 



step 




cell 


X 


j page 


32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT 




ACTION 




OUTPUT 


Behavioral analysis 
data 




Describe task unit 
more general ly 
(i.e., does not 
specify a^ I the 
alternati* 
bilities, 

xi .a 


► 


General ized task 
description (which 
can be used as a 
summary) 


x.a 


► 

1 




xi i .a 



Non-analyzed data 




Describe task unit 

in r^rSnin«i1 
ab 111 yJ* lyiiiai 

information 


► 


Generalized task 
description 




► 








x.b 




:^i.b 




xli.b 


















► 






► 
























^ 






► 






*^ 




from 



step 


5.5 


cell 


• f * 
XI h 


1 page 


32 



INPUT 



SUB-STEP 5.5 



DETAILED ANALYSIS FOR 

ACTION 




Restate tasks as 
objectives 



XIV 



OUTPUT 



Statement of 
objectives, includ- 
ing standards of 
performance 



XV 



ON NEXT I PAGE 



ERLCj 



53 



from 



"itep 


5.5 


celi 


xi i i 


j page 


32 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


Description of 
INPUTS 




For each action to 
be taken, describe 
the appropriate 
conditions for 
taking it 

x?v.a 


—J ^ 


Description of 
conditions cal I ing 
for specified 
performance 

XV .a 


xi i i .a 


► 





Description of 
ACTIONS 




Describe the 
specific performance 
to be taken 


► 


Description of 
performance to be 
taken 


xi i i .b 


► 


xiv.b 




XV. b 



Descri ption of 
OUTPUTS 




Describe the 
outcome or product 
of performance 
in luding tolerable 
limits 


^ 


Description of 
standards of 
performance 




► 






X i i i . C 




xiv.c 




XV. c 




erIq 





56 



from 



step 


6 


cell 




page 


! 



DETAILED ANALYSIS FOR 



ACTION OUTPUT 



STEP 6* 



Raw data col lected 
Step J and/or 
task description 


^ 


Perform behavioral 
or other type of 
task analysis 




Behavioral analysis 








► 




16 




17 




18 



ON NEXT 13 PAGES 



FOLD OUT 
THIS PAGE. 



^Behavioral analysis can be performed as data are collected or from 
task descriptions. Preferably, it should be performed as data are 
being collected and then **perfected** later on. The type of analysis 
performed is presented here in Step 6, although according to the 
above recommendation, means for carrying it out should be built into 
the data collection instruments (Step 5). 



ERIC 



57 



from 



Step 


6 


cell 




page 


1 



MORE DETAILED 
DIAGRAM FOR CHAINS 



Input 



ACTION 



OUTPUT 



SUB-STEP 
6.1 



SUB-STEP 
6.2 



i 



Description of 




Input t act Ion > 


and 


output 






IV 



SUB-STEP 
6.3 



i 



Next unit 






* 




vll 



SUB -STEP 
6.4 



Sequence of units 



Non-analyzed task 
descriptions for 
each task unit 

1 


► 


Identify the input, 
act ion » and output 
for each task unit 

1 i 




Identification of 
input , action, and 
output for task 
unit 

i 1 1 




► 















Analyze for 
discriminations, 
generalizations, and 
associat ions 



Identification of 
discrimlnat ions , 
generalizations , 
and associations 



VI 



Repeat above 
process 




► 


Behavioral 
of next un 


analysis 
t 




vili 






ix 



Identify units 
which are chained 
in a fixed sequence 



xl 



Identification of 
chains a^ 
non-ch^' '-^^ 



xii 



ERLC 



58 



from 



step 


6.1 


ceil 




1 pt^^e 


58 



NO DETAILED ANALYSIS FOR 



SUB-STEP 6.1 



INPUT 



Non-analyzed task 
descriptions for 
each task unit 



ACTION 



Identify the input , 
action, and output 
for each task unit 



OUTPUT 



Identification of 
input, action, and 
output for task 
unit 



from 



step 


6.2 


cell 




1 pnge 


58 



DETAILED ANALYSIS FOR 



INPUT 



ACTION 



SUB-STEP 6.2 



Description of 
input 9 act ion 9 and 
output 



IV 



Analyze for 
discriminations , 
general izations, 
and associations 



OUTPUT 



identification of 
discriminations, 
general izations, 
and associations 



ON NEXT 5 PAGES 



ERLC 



61 



from 



step 


6.2 


cell 


iv 


page 


58 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



STEP 6 



INPUT 




ACTION 




OUTPUT 


Alternative inputs 
or classes of inputs 
require different 
act ions 


► 


Identify inputs to 
be discriminated 




Behavioral analyst s 
includes identifi- 
cation of 
discriminat ions 


(See page 62) 

iv.a 




v.a 


► 


vi .a 



Alternative inputs 
within a class of 
inputs require 
same action 


► 


Identify inputs 
requiri ng 
general izat ions 


1 ^ 


6 havioral analysis 
i^ :1udes ident i- 
fi cat ion of 
general izat ions 


(See page 64} 










i v.b 




v.b 




vi.b 



A series of 
input-action 
associations have 
to be performed in 
correct sequence 

(See pages 

iv.c 


► 


Identify chains 

v.c 




Behavioral analysis 
includes identifi- 
cation of chains 

vi .c 




► 



from 



f 

1 

1 step 


6.2 


ceil 


i v.a 




62 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



ERIC 



Inputs to be 
included in one 
concept category 
vs. inputs to be 
included in another 
concept category 

i v.a. 1 



Conditions leading 
to one decision vs. 
conditions leading 
to another decision 
in a procedural 
task 

i v.a.2 



Differing physical 
or psycholoqical 
properties \of 
object, people, 
events) to be 
identified^ e.q. , 
up/down, right/left 

iv.a.3 



Inputs 


(in other 


types of tasks) to 


be discriminated 


because 


they 


require different 


actions 


iv.a.'* 


• 
• 


INPUTS 








[IK 






iv.a.n 





Identify inputs to 
be discriminated 



Identification of 
discriminations 
involved in terminal 
performance 



vi .a 



63 



from 



step 


6.2 


cell 


i v.b 


page 


62 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



Range of inputs 
that belong wi thin 
a single concept 
category 

iv.b. 1 



Range of conditions 
that lead to the 
same decision in a 
procedural task 

iv.b. 2 



Inputs in other 
ypes of tasks 
which have to be 
seen as the same 
because they 
requi re the same 
action 



INPUTS 




01 






m 










iv.b.n 



Identify inputs 
requi ring 
general izat ion 



v«b 



Identification of 
generalizations 
involved in terminal 
performance 



vi 



ERIC 



64 



I 
I 

■a 

I 



from 



step 




cell 




page 

1 





MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



I 
I 
I 

i 



Actions to be 
associated with 
inputs that are to 
be discriminated 



Actions to be 
associated with 
inputs requiring 
general ization 



Identify actions 
to be associated 
with inputs 



Identification of 
associations 



ERJCI 



65 



from 



step 




cell 




page 





MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



ERIC 



INPUT 



Product ion of a 
series of input- 
action associations 
language behavior 



Performing 
procedures 



Iv,c.2 



Explanation or 
application of 
principles 



iv.c.3 



Perceptual -motor 
tasks 



INPUT-ACTION-OUTPUT 



□->D-^ 



iv^c.n 



ACTION 



OUTPUT 



Identify chains 



v*c 



Identification of 
chains involved in 
terminal performance 



VI .c 



66 



■ 

1 


from 




step 


6.3 


\ 


cell 








58 



NO DETAILED ANALYSIS 
SEE SUB-STEP 6.2 





INPUT 




ACTION 




OUTPUT 




Next unit 




Repeat above 
process 




Behavioral analysis 
of next unit 


6.3 








► 




vii 


► 


vMi 







ERIC I 



67 



I 

J 

I 



Irom 



Mi'p 


6.^ 


cell 




page 


58 



NO DETAILED ANALYSIS 
SEE SUB- STEP 6.2 



INPUT 



SUB-STEP (>.^ 




ACTION 


OUTPUT 


Identify units 




Identi f ication of 


which are chained 




chains and 


in a fixed sequence 




non-chains 








xi 







ERIC 



69 



FOLD BACK 
PAGE 57. 



erJc 



70 



from 



step 


7 






page 


2 



DETAILED ANALYSIS FOR 



'NPUT ACTION OUTPUT 



STEP 7* 



Behavioral analysis 


► 


Review component 
behaviors and 
formally Identify 
required entering 
behavior 




Identification of 
further, more 
detai led prerequl- 
site behaviors 






► 


)<1 




?0 




91 



ON NEXT PAGES 



FOLD OUT 
THIS PAGE. 



*ldeally, behavioral analysis data is collected and reported at a level 
of detail that identifies the skills that must be taught. More detail 
(i.e., a lower, more specific level of detail) is not provided because 
it is assumed that the target population can already perform at these 
lower levels. 

If the appropriate level of detail has not been identified, it is 
necessary to do so at this point. Even If it has been identified, it 
is appropriate to have the judgment reviewed and more detail added if 
necessary. This is done in Step 



ERIC 



71 



from 



step 


7 


ceil 




page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS 



SUB-STEP 
7.1 



SUB- STEP 
7.2 



i 



INPUT 




ACTION 




OUTPUT 


Results of 
behavioral analysis 


► 


Inspect "action" 
terms at level 
specified to deter- 
mine if target popu- 
lation can perform 




Identification of 
"action" terms 
which population 
can and cannot 
perform 

iii 


i 




► 















Identified "action" 
terms 


^ 


Hake additional 
analyses 




Behavioral analysis 
in more detai 1 








► 




iv 




V 




vl 



SUB-STEP 
7-3 



Behavioral analysis 
in more detai 1 



vii 



Identify what is 
prerequisite and 
what must be taught 



viii 



Identification of 
entering behavior 
and what must be 
taught 



ix 



ERIC 



72 



! from 



step 


7.1 


cell 


i 


j page 


11 



DETAILED ANALYSIS FOR 



INPUT 



snB-STEP7. I* 



Results of 
behavioral analysis 



ACTION 



Inspect "action" 
terms at level 
specified to deter- 
_^mine if target popu- 
lation can perform 
it 

Li 



OUTPUT 



Identification of 
"action" terms 
which population 
can and cannot 
perform 



JIl 



ON NEXT 1 PAGE 



*ln this approach, tt is assumed that the actions to be associated with inputs 
are never tauaht. All that Is taught are the component discriminations and 
generalizations (and the chaining of steps or sub-steps). Thus, how to take 
an action is not taught. 



ERLC 



73 



from 



step 


7.1 


cell 


i 


page 


11 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 



INPUT- ACT I ON-OUTPUT 



Target population 
knows how to take 
act I on i . a 



ACTION 



Identify no need for 
Further analysis 



ii.a 



OUTPUT 



Identification of 
actions which 
population can 
perform 



iii.a 



I NPUT-ACT I ON-OUTPUT 

Target population 
does not know how to 
take action 



Identify need for 
further analysis 



Identification of 
actions which must 
be analyzed with 
further detai I , 
i.e. , Into its com- 
ponent discrimina- 
tions and general- 
izations . . . u 
M lib. 





ERLC 




I 



from 



step 


7-2 


cell 




j PHCJO 


72 



INPUT 



SUB-STEP 7.2 



Identified "action" 
terms 



iv 



DETAILED ANALYSIS FOR 
ACTION 



Make additional 
analys is 



OUTPUT 



Behavioral analysis 
in more detai 1 



ON NEXT 1 PAGE 



ERIC] 



75 



from 



step 


7.2 


cell 


iv 


page 


72 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


"Action^' terms 
which population 
can perform 




Leave analysis at 
this level of detail 




Analysis at 
appropriate level 




^ 




^ 




i v.a 




v.a 




vi .^ 












Action terms 
which population 
cannot oerform 




Analyze action 
term for Its 
components (i .e. , 
discriminations , 


^ 


Analysis at 
appropriate level 


iv. b 


► 


general izations , 
and associations) 

v.b 




vi.b 


















► 






^ 









ERIC 



► 

76 



from 



step 


7.3 


cell 






72 



DETAILED ANALYSIS FOR 



INPUT 



SUB-STEP 7.3 



Behavioral analysis 
in more detai 1 



VI i 



ACTION 



Identify what is 
prerequisite and 
what must be taught 



vt I I 



OUTPUT 



Identification of 
entering behavior 
and what must be 
taught 



ix 



ON NEXT 1 PAGE 



ERIC 



77 



from 



step 


7.3 


ceil 


vii 


pdqe 


72 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



OiagraiTvned steps and 


► 


Identify as what 
must be taught 

vi i i .a 




Identification of 
discriminations, 
general izatlons, 
associations, and 
chains which must 
be taught 

ix.a 


thei r components 

vi i .a 




► 



Hore detai led 
components not 
diagrammed 




Identify* as 
pre requisites 




Identification of 
prerequis i tes 




► 




► 




vi i .b 




vi i i .b 




ix.b 







*Expl icitly or 
impl icitly. 
Expl Icit identi f i- 
cation if diagnos** 
tic tests are 
requi red 


► 




► 






ERIC 









>■ 


FOLD BACK 
PAGE 71. 


► 





28 



from 



step 


8 


cell 




page 


2 



DETAILED ANALYSIS FOR 



INPUT 




ACTION 




OUTPUT 


Behavioral analysis 
at appropriate 
level of deta! 1 


► 


Perform learning 
analysis 




Identification of 
learning difficul- 
ties, common 
components, etc. 








► 


22 




23 




2k 



ON NEXT 10 PAGES 



FOLD OUT 
THIS PAGE. 



ERIC 



79 



from 



step 


8 


cell 




page 


2 



*ldentlf Icatlon of learning difficulties and suggested ways 
to overcome them may be accomplished during the data 
collection stage of the development process. This Is 
perhaps the ideal place to accomplish this step. If so 
done, Step 8 merely requires its completion and refinement. 

MORE DETAILED 
DIAGRAM FOR CHAINS 



SUB-STEP 
8.1 



INPUT 




ACTION 




OUTPUT 


Complete behavioral 
analysis (I.e., at 
appropriate level 
of detail) 

■ 


► 


Identify common 
components in 
different parts of 
chain 

II 




Identification of 
common components 




► 


Ml 













SUB-STEP 
8.2* 



Parts of chain not 
duplicated (by 
presence of Iden- 
tical components) 

IV 


► 


Analyze for learn- 
ing difficulties 

V 




Identification of 
learning difficul- 
ties 




► 
















I 

I 

I 

I 



from 



step 


8.1 


cell 




1 Pdge 


80 



SUB-STEP 8.1 



DETAILED ANALYSIS FOR 



INPUT 


ACTION 


Complete behavioral 




Identify common 


analysis (i.e. » at 




components in 


appropriate level 




different parts of 


of detai 1 ) 


► 


chain 






li 



OUTPUT 



Identification of 
common components 



XL 



ON NEXT I PAGE 



I 

A 

i 
I 



81 



from 



step 


8.1 


cell 




page 


80 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



Ident ical or 
highly simi lar 
di scriminat ions » 
general izat ions 9 or 
associations in 
different parts of a 
total chain j^g 


► 


Identify portions 
of chain containing 
identities or 
simi lari ties 

i i .a 




Identification of 
overlaps vvhich wi 1 1 
require no separate 
instruct ion 

« « « 
1 1 1 .a 




► 



Absence of identical 
or highly simi lar 
discriminations , 
genera lizations» or 
associations in 
different parts of a 
total chain 



Identify chain as 
lacking identi ties 


► 


Identification of 
uniqueness whi ch 
wi 1 1 requi re 
separate instruc- 
tion 






i i • b 




1 M .b 





EMC 



82 



from 





8,2 


celt 




1 Pdqe 


80 



i 

DETAILED ANALYSIS FOR 





INPUT 




ACTION 




OUTPUT 


8,2 


Parts of chain not 
dupl icated (by 
presence of iden- 
tical components) 




Analyze for learn- 
ing difficulties 


^ 


identification of 
learning difficul- 
ties 


► 


— ^ 




VI i 



ON NEXT ^ PAGES 



from 



step 


8.2 


cell 


iv 


page 


80 



MORE prTAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


Presence of 
variables affecting 
difficulty of 
OISlRIMINATIONS 


► 


Ident t fy as a 
difficulty in 
ocqui ring 
discriminations 




Learning difficulty 
ident i fied 


(See diagram on 
page 85) 

1 V • a 




v.a 


► 


vi .a 



Presence of 




luent i fy as a 




Learning di ff icul ty 


variables affecting 




difficulty in 




ident i f ied 


difficulty of 




acqui ring 






GENERALIZATIONS 


► 


general izations 






(See diagran on 






^ 




page 86) 




v.b 




vi • b 



Presence of 
variables affecting 
difficulty of 
ASSOCIATIONS 

(See diagram on 
page 87) 


► 


Identify as a 
difficulty in 
acqui ring 
associat ions 

v.c 




Learning di ff icul ty 
ident if ied 

vi .c 




► 



Presence of 
variables affecting 
difficult/ of CHAINS 




Ident i fy as a 
difficulty in 
acqui ring chains 




Learning di ff icul ty 
ident i fied 


(See diagram on 
page 88) 


► 












► 




i v.c 




v.d 




vi .d 



erJc 





MORE DETAILED 
DIAGRAM FDR GENERALIZATIONS 



INPUT ACTION OUTPUT 



High s Imi lari ty 
among inputs 



i v.a* I 



Large number of 
properties creating 
the differences 
among inputs which 
have to be 
discriminated 

iv*a*2 



Large number of 
different inputs 
(or input classes) 
to be discriminated 



iv*a*3 



Identi fy as a 
difficult 
DISCRIMINATION 
to learn 



v.a 



Identification 
of a difficult 
discrimination 
to learn 



85 



from 



step 


8.2 


cell 


iv. b 


page 





MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



High dissimi lari ty 
among inputs 



iv.b.l 



Large number of 
properties 
contributing to the 
simi lari ty among 
inputs requiring 
general izat ion 

iv.b.2 



Large number of 
inputs (or classes 
of inputs) requir- 
ing generalization 



IV 



I dent i fy as a 
difficult 
GENERALIZATION 
to learn 



v.b 



Identification 
of a difficult 
generalization 
to learn 



vi .b 



ERLC 



86 



from 



step 


8.2 


cell 


Iv.c 


pdgt* 

1 





MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



Large number of 
associations 
between inputs and 
actions 



Iv.c. 1 



Other actions 
already strongly 
associated with 
inputs 



iv.c.2 



Identify as a 
difficult 
ASSOCIATION 
to learn 



v.c 



tdentif ication 
of a difficult 
association 
to learn 



vl .c 



ERLC 



87 



from 



step 


8.2 


cell 


iv. d 




8^1 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



tNPUT ACTION OUTPUT 



Long chain to be 
learned 



iv.d. I 



Parts of chain 
already strongly 
associated with 
other input-action 
associations 

iv.d. 2 



High simi lari ty of 
outputs among one 
or more parts of 
chain (leading to 
possible confusion 
of next step) 

Iv.d. 3 



ERLC 





Identify as a 




Identi f ication of 




difficult CHAIN 




a difficult chain 




to learn 




to learn 


— ► 












► 






v.d 




vi .d 



FOLD BACK 
PAGE 79. 



88 



from 



step 


9 


cell 




page 


2 



DETAILED ANALYSIS FOR 



INPUT ACTION OUTPUT 



STEP 9* 



Results of: 
behavioral analysis 

learning analysis 

25 


► 


Making chunking 
and sequencing 
decisions 

2£ 




Decisions about 
size and content of 
learning units and 
about sequences in 
which units should 
be presented 

27 




► 



ON NEXT 12 PAGES 



*The performance of Step 9 (identification of learning units and sequencing 
of units) may appropriately be considered to involve "strategy*' considera- 
tions and, therefore, should be performed in Step 11. Since, in any case, 
the task precedes the tasks in Step 11, it remains convenient to perform 
this task as Step 9. Moreover, it is useful for the step to precede Step 10 
(preparation of tests) which, in order to be performed with some degree of 
organization, requires some degree of organization of the material (l^e^, 
the identification of units) about which the tests will test* 



FOLD OUT 
THIS PAGE. 



ERIC 



89 



from 



step 


9 


cell 




page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS 



INPUT ACTION OUTPUT 



SUB- STEP 
9.1 


Results of 
behavioral analysis 

learning analysis 


► 


Review for making 
decisions about 
how to create 
instructional units 




Identification of 
tentative units 




i 




i! 


► 


• • • 
1 1 1 



SUB- STEP 
9.2 



Tentative units 



iv 



Hake decision about 
order in which to 
teach units 



Decision about 
sequence of units 



VI 



SUB-STEP 
9.3 



£ 



Individual units 




Hake decision about 




Decision about 






order in which to 




sequence within 






teach components 




units 




► 


within units 


► 




vfi 




vili 




Ix 




from 



step 


9.1 


cell 




I 


90 



i 
I 

S^B 

I 



INPUT 



DETAILED ANALYSIS FOR 

ACTION 



OUTPUT 





Results of 




Review for making 




Identification of 




behavioral analysis 




decisions about 




tentative units 








how to create 






111 


learning analysis 




instructional units 


^ 




i 


► 


i! 




iit 



ON NEXT 3 PAGES 



ERIC 



i 
I 
i 
I 
I 
I 
I 



91 



from 



step 


9.1 


cell 


i 


page 


90 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (D 



INPUT 




ACTION 




OUTPUT 


Terminal task 
involves one long, 
continuous chain 

(See generalizations 
on page 9S) 

i.a 


► 


Identify portion 
of total chain 
learners can master 
in instructional 




Identification of 
instructional 
unit (s) 




hour 

i I .a 


► 


III. a 



Terminal task 
involves a series 
of smaller, separate 
(unrelated) chains 

(See generalizations 
on page 94) 




Identify number 
of total chains 
learners can master 
in instructional 
hour 

i i .b 




Identification of 
instructional 
unit (s) 

• • • i_ 
1 1 1 .b 


► 


► 





ERIC 




from 



i 
I 
I 

I 



step 


9.1 


cell 


i .a 


page 


92 



I 
I 
I 

i 

ER?C | 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



Performing a 
science experiment 



i >a> I 



Solving an algebra 
problem 



i.a.2 



Wri ting an essay 



Performing a 
musical composition 



Other performance 
areas involving 
a long series of 
interrelated steps 



i .a.r 



ACTION 



Review for making 
decisions about 
how to create 
instructional units 



i i .a 



OUTPUT 



Identification of 
tentative units 



iii.a 



93 



from 



step 


9.1 


cell 


i.b 


page 


92 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



erJc 



Defining a concept 
in physics 



Stating a principle 
in chemistry 



i.b. 2 



Giving an explana- 


tion for 


events 


observed 


in the 


physical 


world 




i.b. 3 



Giving an example 
of a principle 
in biology 



i.b. 4 



Other knowledge 
domain behaviors 
make up chains 
not related to 
other chains 



i .b.n 



OUTPUT 



Review for making 
decisions about 
how to create 
instructional uni ts 



i i .b 



Identification of 
tentative units 



• • • i_ 
M I .b 



from 



step 


9.2 


celt 




page 


90 



DETAILED ANALYSIS FOR 



I 
I 

SUB-STEP 9.2 

I ~ 
I 



INPUT 




ACTION 




OUTPUT 


Tentative units 




Make decision about 
order in which to 
teach units 


^ 


Decision about 
sequence of units 


iv 


► 


V 




vi 



I 
I 
I 
I 
I 
I 
I 

I 

ER?C | 



ON NEXT 1 PAGE 



95 



from 



4 

Step 


9-2 


cell 


iv 


page 


90 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 



Unit covers 


only 


portion of 


long 


chain (othe 


r units 


are related 


to it 


In a single 


chain) 




1 V. a 



ACTION 



Make plans to order 
chaining of separate 
units in a fixed 
forward or backward 
order 

v.a 



OUTPUT 



Plan for sequencing 
of units 



VI •a 



Unit is related to 
other units (but 
not in a single 
chain) 


>■ 


Hake plans to order 
learning of units 
that wi 1 1 faci 1 i tate 
learning of subse* 




Pla.T for sequencing 
of units 






quent units 


► 




i V* b 




v.b 




vi •b 



Unit is self- 




Make no speci f ic 




Plan for sequencing 


contained (not 




plans about orderinc 




of units 


related to other 




of units 






uni ts) 


► 














► 




Iv.c 




v.c 




vi .c 






from 



i 
I 
I 

I 



Step 


9.3 


coll 




1 p*«g«i 


90 



DETAILED ANALYSIS FOR 





INPUT 




ACTION 




OUTPUT 


STEP 9.3 


Individual units 




Make decision about 
order in which to 
teach components 
within units 

vi i i 




Oeci sion about 
sequence wi thin 
units 


• • 

VI 1 


► 




ix 



ON NEXT 3 PAGES 



er|c 



I 
I 
I 
I 
I 
I 

I 
I 



97 



from 



step 


9.3 


cell 


vi i 


page 


90 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (i) 



INPUT 




ACTION 




OUTPUT 


Instruct ional unit 
involves a single 
chain containing 
interrelated steps 




Arrange steps so 
they can be taught 
In either a forward 
or backward order 




Sequencing of 
steps within an 
instructional unit 


vi i .a 


► 


vi i i.a 


► 


ix.a 



Instructional unit 
involves a series 
of separate 9 
unrelated chains 




Decide on any 
order in whi ch to 
teach each separate 
chain 




Sequencing of 
steps within an 
instructional unit 




► 




^ 




x/M.h 




VI 1 1 .b 




Ix^b 



from 



i 

* stop 


9.3 


1 cell 


vi i . b 


9 page 


90 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



ACTION 



OUTPUT 



er|c 



I 
I 
I 
I 



I 
I 
I 

\ 

i 
I 



Learning 


to spel 1 


separate 


words 




vi i . b. I 



Learning to locate 
ci t ies on a map 



vi i .b.2 



Learning to identi- 
fy the number of 
electrons in 
different elements 



vi i .b.3 



Learning to define 
several (unrelated) 
science concepts 



vi i .b.^ 



Other learning 
tasks which are 
unrelated one to 
the ctbcr 



vi i •b.r 



Decide on any 
order in which to 
teach each separate 
chain 



vi i i .b 



Sequencing of 
steps within an 
instructional unit 



ix.b 



99 



from 



step 


9.3 


cell 


vi i 


page 


90 



MORE DZTAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT 




ACTION 




OUTPUT 


OUTPUT 
within a single 
step in a chain 


► 


Plan to teach 
discriminations and 
general izations 
about OUTPUTS first 


► 


Decision about what 
to teach first 
wi thin a step 


O H 1 HB vi i .a 




(if not already in 

repertoi re) 
^ VM 1 .a 




ix.a 



INPUT 
within a single 
step in a chain 



vi i .b 



Plan to teach 
discriminations and 
genera! izations 
about INPUTS second 



(if not already in 
repertoi re) 

vi i i .b 



Decision 


about what 


to teach 


second 


within a 


step 




ix.b 



INPUT - ACTION 
associat ion 
wi th in a single 
step in a chain 



VI I .c 



Plan to teach 
associations thi rd 
(if not a 1 ready in 
repertoi re) 



VI II .c 



Decision 


about 


what 


to teach 


third 




within a 










ix.c 







► 




► 


FOLD BACK 
PAGE 89. 







inn 



from 



step 


10 


cell 




page 


2 



DETAILED ANALYSIS FOR 



STEP 10 



INPUT 




ACTION 




OUTPUT 


Learning units 
+ 

task descriptions 
from Step 5 
(statements of 
objectives) 

?8 


► 


Develop criterion 
performance tests 




CrI terion 
performance tests 




29 


► 


^0 



ON NEXT 16 PAGES 



FOLD OUT 
THIS PAGE. 



ERIC 



101 



from 



step 


10 


cell 




page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS 



INPUT ACTION OUTPUT 



Task descriptions 
(or statements of 
objectives) for each 
learning unit 

1 


► 


Identify for each 
task or objective 
character of inputs , 
actions, outputs 

1 i 




Identification of 
character of inputs, 
act i ons , outputs 

ii! 




► 



Identification of 
SUB-STEP character of inputs, 
10.2 actions, outputs 



IV 



Review for 

feasibi 1 ity of using 
actual inputs , 



actions, and outputs 
as they appear in 
the task 



Assessment of 
feasibi 1 ity of using 
actual inputs, 
actions, and outputs 
on tests 



SUB-STEP 
10.3 



either/ 
or 

SUB-STEP 
10.^ 



Tasks for which it 
is feasible to use 
actual inputs, 
actions, outputs 



VI I 



Plan to construct 
test items using 
actual inputs, 
actions, outputs 



VIII 



Plans for construct- 
ing criterion tests 



IX 



Tasks for which it 
is not feasible to 
use actual inputs, 
actions, outputs 

X 


► 


Plan to construct 
test items using 
simulated inputs. 




actions, outputs 




1 



Plans for construct- 
ing criterion tests 



SUB-STEP 
10,5 



ERIC 



Plans for criterion 
test 


► 


Develop, try out, 
and revise test 
items 




Pool of revised 
test items 








► 




xi i i 




xiv 




XV 



102 



from 



cell 



pdge 



10. I 



102 



DETAILED ANALYSIS FOR 



INPUT ACTION OUTPUT 



STEP 10>1 


Task descriptions 
(or statements of 
objectives) for each 
learning unit 

i 




identify for each 
task or objective 
character of inputs, 
actions, outputs 

ii 


^ 


Identification of 
character of inputs 
actions, outputs 

• • • 
1 1 1 


► 





ON NEXT 2 PAGES 



103 



from 



step 


10.1 


(ell 


i 


page 


102 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (D 



INPUT 




ACTION 




OUTPUT 


Modality of 
terminal inputs* 
1 


► 


Characterize 
modal ity of inputs 




Inputs character- 
ized as visual , 
auditory, tacti le, 
kinesthetic, 








► 


olfactory 


i .a 




i i .a 




i i i .a 



Modal ity of 




Characterize 




Inputs character- 


terminal inputs* 




modal i ty of inputs 




ized as symbol ic, 


II 








non-symbol ic 




► 




► 




i.b 




i i .b 




M 1 .b 



Modal ity of 
terminal inputs* 
III 


► 


Characterize 
modal ity of inputs 




Inputs character- 
ized as an imate or 
inan irnate 








► 




i.c 




i i .c 




i i i • c 



Modal ity of 
terminal inputs* 
IV 


► 


Characterize 
modal ity of inputs 




Inputs character- 
ized as stationary 
or moving 








► 




i.d 




ii.d 




i { i .d 



*AI$o applies to outputs 



ERIC 




from 



step 



10.1 



celt 



paqc 



102 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT ACTION OUTPUT 



Modal ity of actions 
1 




Characterize 
modality of actions 


► 


Actions character- 
ized as symbol Ic 
or non-symbolic 




► 








i .a 




• • 

1 1 .a 




1 i i .a 



Modal ity of actions 
1 1 




Characterize 
modality of actions 


► 


Actions character- 
ized as perceptual , 
motor, procedural 


l.b 


► 


II. b 




1 1 1 .b 



Modal Ity of actions 
III 




Characterize 
modality of actions 

• • 

1 1 .c 


■ ► 


Actions character- 
ized as recognition, 
edi ting, or 
product ion 

i i 1 .c 


■ ► 







from 



step 


10.2 


celi 






102 



I 
I 
I 



INPUT 



DETAILED ANALYSIS FOR 



ACTION 



sae-sTEP 10.2 



Identification of 
character of inputs, 
actions, outputs 



OUTPUT 



Review for 

feasibi I ity of using 
actual inputs, 
actions, and outputs 
as they appear in 
the task 



/\ssessment of 
Feasibi I ity of using 
actual inputs, 
ctions, and outputs 
0n tests 

ki 



ON NEXT 3 PAGES 



i 

ER1C | 



from 



step 


10.2 


(.ell 


i V 


page 


102 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



Character! Sties of 

actual inputs ^ 

actions^ or outputs 

which make them 

feasible for use in 

test? (See general^ 
tzattons on p. 109) 
iv.a 


► 


Make Judgment of 
feasibi i i ty 

v,a 




Assessment of 
feasibi I i ty of 
using actual 
inputs, actions, anc 
outputs in tests 

vi .a 




► 



Characteristics of 
actual inputs, 
actions, or outputs 
whi ch make them 
unfeasible for use 
in tests (See gen- 
eralizations on 
p. lid) iv.b 




Make judgment of 
unfeasibi lity 

v.b 




Assessment of 
unfeasibi 1 i ty of 
using actual 
inputs, actions, anc 
outputs in tests 

vi .b 


► 


► 



1 

i 





from 



I 

I 



I 
I 
I 

i 

ERLC I 



step 



cell 



page 



10*2 



108 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT 



Administratively or 
log! stical ly 
convenient to use 
actual inputs, 
actions, or outputs 

iv*a* 1 



Financial ly possi- 
ble to use actual 



inputs, actions, or 
outputs 



iv*a*2 



Low probabt 1 i ty 
of physical or 
psychological 
damage when using 
actual inputs, 
actions, or outputs 

iv>a>3 



ACTION 



OUTPUT 



Hake judgment of 
feasibi I i ty 



v.a 



Assessment of 
feasibi 1 ity of 
using actual inputs, 
actions, and outputs 
in tests 

vi •a 



109 



from 



step 


10.2 


cell 


iv.b 




108 



MORE DETAILED 
DIAGRAM FOR GENERALIZATIONS 



INPUT ACTION OUTPUT 

Administrat i vely or 
logistically 
inconventent to use 

actual inputs, 

actions, or outputs 

iv.b. 1 



Financially costly 
to use actual 
inputs, actions , or 
outputs 



iv.b. 2 



High probabi 1 i ty of 
physical or psycho- 
logical damage 
when us i ng actual 
inputs, actions , or 
outputs 

i v>b. 3 



ERIC 






Make judgment of 
unfeas ibi 1 ity 

v.b 




Assessment of 
unfeas ibi 1 i ty of 
using actual 
inputs, actions, 
and outputs in 
tests 

vi .b 


— ► 


► 



no 



I 

I 



from 



step 


10.3 


cell 






102 



NO DETAILED ANALYSIS FOR 



INPUT 



SUB-STEP 1^*3 



Tasks for which it 
is feasible to use 
actual inputs^ 
act ions 9 outputs 



VI I 



ACTION 



OUTPUT 



Plan to construct 
test items using 
actual inputs^ 
actions^ outputs 



VIII 



Plans for construct 
ing criterion tests 



ERiC 



III 



step 


10. A 


cell 




1 pnge 
1 


102 



I 

I 

I 
I 
I 

I 

SUB-STEP \0.t\ 

I ~ 
I 



from 



INPUT 



Tasks for which it 
is not feasible to 
use actual inpuCs, 
actions, outputs 



DETAILED AN/LYSIS FOR 

ACTION 



Plan to construct 
test items using 
s imulated inputs, 
actions, outputs 



OUTPUT 



Plan for construct- 
ing criterion tests 



JLLL 



ON NEXT 1 PAGE 



I 
I 
I 
I 

erJc 



113 



from 



step 


]0A 


cell 


X 


page 


102 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



Input 




ACT ION 




OUTPUT 


Need to simulate 




Plan to use 




^imuiciLea tebL 


test of PERFORMANCE 




-Paper-and-penci 1 
descnpt ions of 




approximates 
criterion behavior 







performance 










si tuations 
-Simulated equipment 


► 




x.a 




xi .a 




xi i .a 












Need to simulate 




Plan to use 




Simulated test 


test in KNOWLEDGE 




-Paper and penci 1 




approximates 


DOMAIN 




descript ions of 




criterion behavior 




► 


performance 










si tuations 


► 




x.b 




xi.b 




xii.b 



Need to 


simulate 




Plan to use 




Simulated test 


test in 


AFFECTIVE 




-Attitude 




approximates 


DOMAIN 






quest ionnai res 




cri terion behavior 






► 


-Role-play 












situations 


► 






x.c 




xi.c 




/ XI 1 .c 



Need to s imulate 
test of SOCIAL 
BEHAVIOR 


► 


Plan to use 
-Role-play 

s i tuations 
-Paper-and-penci 1 

descriptions of 

performance 

si tuations xi .d 




Simulated test 
approximates 
criterion behavior 


x.d 




► 


Xt i .d 



from 



step 


10.5 


cell 


xi i i 


page 


102 



MORE DETAILED 
DIAGRAM FDR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



Plans to test for 
ACHIEVEMENT 


► 


Develop NORM- 
referenced tests 




Criterion test 
for achievement 








► 




xi 1 1 .a 




xiv.a 




XV. a 



Plans to test for 
PROFICIENCY 




Develop CRITERION- 
referenced tests 


► 


Criterion test 
for proficiency 




► 








• • • 1 

XI It .b 




xiv.b 




XV. b 





ERIC 












FOLD BACK 
PAGE 101. 


p. 





from 



I 
I 

I 



step 


11 


cell 




I 


2 



STEP 11* 



DETAILED ANALYSIS FOR 



INPUT 




ACTION 




OUTPUT 


Learning units + 
sequences + identi- 
fication of learning 
difficulties + 
common components + 
objectives + tests 

11 




Formulate 

instructional 

strategies 


► 


Description of 
instruct ional 
strategies for 
each unit 


^ 


12 




33 



*Four more detailed, self-contained sub-chains are presented on the next 
four pages. 



ON NEXT 58 PAGES** 



**Detailed breakdowns are presented for only some of the sub-steps in each 
of the four sub-chains. 



ERIC 



117 



from 



step 


11 


ceil 




page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS (i) 



SUB-STEP 

n .1 



SUB-STEP 
IK2 



INPUT 



For each learning 
unit ; 

Objectives and 
tests 



Identification of 
the nature of 
inputs 9 actions, 
and outputs 



ACTION 



Characterize the 
terminal performance 



1 1 



Assess the feasibili- 
ty of using actual 
inputs, actions, and 
outputs in practice 
s i tuat ions 



OUTPUT 



Identification of 
the nature of the 
inputs , act ions , and 
outputs 



iii 



Identification of 
need to simulate 
(or not to simulate) 



VI 





y 


r 










SUB- STEP 

n.3 


Identification of 
simulation needs 




Prescribe character 
of terminal practice 


► 


Ident if ication of 
inputs , act ions , and 
outputs to be used 
in terminal practice 








► 












vi i 




vi 1 1 




ix 





y 












SUB-STEP 


Inputs, actions, 
and outputs to be 
used in terminal 
practice 




Prescribe media 
requi rements 


► 


Identification of 
media capable of 
presenting inputs 
and allov/ing practia 
of actions 








► 














xi 




xi i 



BEGINNING 
OF NEW 
CHAIN 

SUB- STEP 
O 1.5 

ERIC 



Terminal Inputs, 
actions, and outputs 
in practice and 
results of learning 
analysis. 

i 




Characterize diffi- 
cult ies in going 
from entering 
behavior to terminal 
behavior 

ii 


► 


Ident if icat ion of 
difficulties for 
which assistance is 
necessary 

i 1 i 


► 





from 





1 1 


cell 




1 page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS (2) 



] 


INPUT 




ACTION 




OUTPUT 


SL'B-STEP 
: IK6 


Ident i f icat ion of 
potential learning 
diff icul tl^s 




Prescribe types of 
assistance to be 
used 


► 


Prescription of 
types of cues to be 
used and types of 
response practice to 
be required 






► 








iv 




V 




vi 



i 



S 3-STEP 
11.7 


Prescription for 
types of assistance 
and practice 




Plan type of 
preparatory practice 


► 


Description of 
planned preparatory 
practice 






► 










vi i 




vi i i 




ix 



i 





Descr i ption of 




Describe media 




Media prescriptions 


S 3-STEP 


planned preparatory 




requirements for 






11.8 


pract ice 




preparatory practice 


► 
















END OF 


X 




xi 




xi i 





Descriptions of 




Characterize 




Characterization of 


Su3-STEP 


terminal 


practice 




potential problems 




to what (and when) 


11.9 


and preparatory 




in attending or 




attent ion or obser- 




pract ice 






obf^rving behavior 


^ 


vation needs to be 








► 






drawn 




! 




i 




ii 






• • • 

1 1 1 


I 
















\ 




r 












I 


Characterization of 




Prescribe solutions 




Prescription of 


S{ STEP 


attent ion 


and 








cues that can el icit 


1 11.10 


obse>-vatlon problems 






► 


attention or obser- 








► 






vation 


















vi 


ERIC i 




iv 




V 







J (Continued) 



from 



step 


1 1 


cell 




page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS (3) 



INPUT ACTION OUTPUT 



SUB-STEP 
ii. II 



Prescription for 
attending cues 




Prescribe media 
requi rements 


► 


Prescription for 
media requirements 
to present cues to 
control attending 
behavior 




► 






vi i 




vi i i 




IX 



CHAIN 



SUB-STEP 
11.12 



Post- instruct iona I 
context 




Characterize 
retention and 
transfer problems 


► 


Characterization of 
retention and 
transfer problems 




► 








i 




i i 




i i i 



f 



SUB-STEP 
11.13 


Characterization of 
retention and 
transfer problems 




Prescribe review 
and varying prac- 
tice opportunities 


► 


Prescription for 
additional and more 
varied practice 




iv 


^ 


V 




vi 



SUB-STEP 
li.lJt 


Prescription for 
additional and more 
varied practice 




Assess media 
requi rements 


► 


Media prescription 
for additional 
practice 






► 










vii 




VI i i 




ix 


END OF 
CHAIN 












SUB-STEP 
II. 15* 


Characterization of 
terminal performance 




identify types of 
performance requir- 
ing creation of 
reinforcement 
contingencies 

• • 

i 1 





Identification of 
performance areas 
requiring creation 
of reinforcement 
cont Ingencles 

ttt 


0 


1 


► 





*This may precede or follow chain beginning at 1 U12 

120 ^ 



(Continued) 



I 

I 

I 
I 



from 



step 


11 


cell 




j page 


2 



MORE DETAILED 
DIAGRAM FOR CHAINS (M 



IIB-STtP 
11.16 



INPUT 




ACTION 


Identification of 
performance areas 
requiring creation 
of reinforcement 
contingencies 




Analyze for 
occasions during and 
after training to 
provide reinforcement 




^ 




iv 




V 





OUTPUT 



Identification of 
opportunities and 
requirements to 
reinforce terminal 
behaviors 



VI 



; JB-STEP 
^ 11.17 



Identification of 
opportunities to 
provide reinforce- 
ment and character- 




Identify suitable 
rei nforcers 


^ 


Identification of 
reinforcers suitable 
to population and to 
training situation 


istics of target 


► 










population 












vi i 




VI i 1 






ix 
















ERIC i 









^ 


1 

1 

1 — 


>■ 





from 













IKl 


i 






1 




I 






118 









aSL DETAILED ANALYSIS FOR 



INPUT 



For each learning 



uni t ; 



Objectives and 
SUB-STEP 1 l.H tests 



ACTION 

Characterize the 
te rm i na 1 pe. rf o rmance 



I i 



OUTPUT 

Identification of 
the nature of the 
inputs, actions, 
and outputs 



J-LL 



^Comparable to Sub- step 10.1 , page 103> 



ERLC 



123 



I 

I 

\ 



from 





II. 2 


cell 


iv 


j page 


118 



NO DETAILED ANALYSIS FOR 



INPUT 



Identification of 
the nature of 
inputs, actions, 
SUB-STEP 1 1 .24and outputs 



ACTION 



Assess the feasi- 
bility of using 
actual inputs, 
actions , and outputs 
in practice 
si tuat ions 



OUTPUT 



Identification of 
need to simrlate 
(or not to 
simulate) 



VI 



*ConiparabIe to Sub-step I0>2 , page 107* 



ERIC 
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from 



sirp 

vvM 


11.3 


. 

1 p'^y*? 


118 



HO DETAILED ANALYSIS FOR 



I 

I 





INPUT 




ACTION 


1 


Ident i f ication of 
s imul at ion needs 




Prescribe character 
of terminal practice 


SUB-STEP 1 1.3* 

1 ~ 




► 




vi i 




vi f i 



OUTPUT 



Identification of 
inputs, actions, and 
outputs to be used 
in terminal practice 



*ComparabIe to Sub-step 10»4 , page 1 





127 



from 



step 




ceil 






118 



DETAILED ANALYSIS FOR 



INPUT 



ACTION 



SUB-STEP 11.^ 



Inputs, actions, 
and outputs to be 
used in terminal 
pract i ce 



Prescribe media 
requi rcments 



XI 



OUTPUT 



Identification of 
media capable of 
present ing inputs 
and a1 lowing prac- 
tice of actions 

2Ui. 



ON NEXT 6 PAGES 
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from 
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11.^ 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (D 



INPUT 



ACTION 



OUTPUT 



Visual inputs 


► 


Prescribe medium 
that can display 
inputs 


► 


Prescription of 
medium that can dis* 
play: real inputs 
(objects , people) , 
reproduced i nputs 
(pictures , film), 
fabricated inputs 
(animation, draw- 
ings , simulator) 

xi i .a 


X. a 




xi .a 













Auditory inputs 




Prescribe medium 
that can display 
inputs 


► 


Prescription of 
medium that can dis- 
play: real inputs 
(1 ive voi ces , 
objects that produce 
sounds) , reproduced 
(tape recorder , 
records) , fabricatec 
(synthesizers, simu- 
lator) xi i .b 


X. b 





xi . b 













Other inputs: 




tact lie. 




kinesthet ic , 




olfactory 






x.c 



Prescribe medium 
that can display 
inputs 



XI .c 



*Also applicable to OUTPUTS 



Prescription of 
medium tliat can dis 
play: real inputs 
(actual objects) , 
reproduced (mock- 
ups) , fabricated 

(s imu lator) 

xi t .c 





i I . ^ 

' . MORE DETAILED 

DIAGRAM FOR DISCRIMINATIONS (2) 





INPUT 




ACT JON 


OuTP'jT 


* 


Animate Stat ionery 
i nputs 




Prescribe rc^dia 
that can display 
i nputs 




Prcscr i pt ion : 
pictures of people 






^ 










x.a 




X i .a 




X i i . a 



Animate moving 
inputs 




Prescr 1 be med ia 
,.hat can display 
inputs 


^ 


Prescriotion: 
people , f i Im of 
people 




► 








x.b 




X i .b 




xi i • b 



Inanimate stationery 
inputs 




Prescribe media 
that can display 
inputs 


^ 


Prescription: 
objects, pictures 
of objects 




► 








X. c 




xi .c 




xi i .c 



lnan!iiate moving 
i nputs 




Prescribe media 
that can display 
inputs 


^ 


Prescription: 
film of objects 


x.d 


► 


xi .d 




xi i .d 



*Also applicauie to OUTPUTS 



MORE OETAiLEO 
DIAGRAM FOR DiSCRiMiNATIONS (3) 





INPUT 




ACT ION 




OUTPUT 


it 


Symbolic inputs 





Prescribe medium 
that can display 
inputs 


► 


Prescript ion: 
print {on paper , 
si ides) , sound (on 
tape, records) 




x.a 




xi .a 




xi i .a 



Non-symbol ic inputs 




Prescribe medium 
thdf can display 
inputs 


1 




► 






x.b 




xi • b 





Prescription: 
objects or people; 
actual ; reproduced 
in pictures , s 1 ides , 
or film; or fabri- 
cated in drawings 

xi i « b 



*Also applicable to OUTPUTS 



from 




MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




Output 


Actions are at the 
RECOGNITION level 




Prescribe medium 
thac permits action 
to be taken at the 
recogni tion level 


► 


Prescription to 
al low select ing f rcn 
opt ions : by point* 
i ng , check inq 
(paper and pencil) 




► 






x,a 




xi «a 




X i t « a 



Actions are at the 





Prescribe medium 
that permi ts action 
to be taken at the 
editing level 


^ 


Prescription to 
al low evaluation or 
revision: media that 
allow either symbol- 
ic (oaper-and-pencil 
or non-symbol ic 
(motor, procedural) 
editing xii«b 


EDITING level 

x-b 




xi «b 





Actions are at the 
PRODUCTION level 




Prescribe medium 
that permi ts action 
to be taken at the 
production level 


► 


Prescription to 
al low product ion : 
symbo 1 i c (papcr-and- 
penci \ , oral ) , non^ 
symbol ic (motor, 
procedural ) 




► 




x*c 




xi «c 




xi i «c 





from 



step 



i>*w j 118 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (5) 



*^^PUT ACTION OUTPUT 



MOTOR actions 




Prescribe medium to 




Prescr ipt ion : 






permit actions 




-actual equipment 




► 






or simulator 


X. a 




xi • a 




X i i « a 



.'PROCEDURAL actions 


► 


Prescribe n^edium to 
permit actions 




Prescription : 
-actual equipment, 

simulator, or 

materials 








► 


-paper-and-penc i 1 


X* b 




xi *b 




X i i .b 



PERCEPTUAL actions 


► 


Prescribe medium to 
permit actions 




Prescript ion : 
-media that al low 
identification of 
what has been per- 


X. c 




r i .c 





ceived by pointing, 
checking , etc. ; 
e.g. , pictures, 

nbj^rfi; Xli.C 




► 














► 





I3A 



MORE DETAILED 
DIAGRAM FOR DISCRIMIN/TIGNS (6) 

ACT ION OUTPUT 

Prescription: 
media to al low wri t- 
i ng or point inq 
tpaper and pencil, 
visual displays) , 
listening (auditory 
present at ion) , , read- 
ing (visual printed 

displays) ^^lL±. 



NON-SYMBOLIC actions 
x-b 




Prescribe medium 
to al low actions 

xi .b 


► 


Prescription: 
media to al low non- 
symbol i c motor , 
procedural , or per- 
ceptual actions 
(see preceding ■ 
pages) ^ii.b 


' >- 

























^ 




















► 




► 







135 



frofn 



rell 
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INPUT 



SYMBOLIC actioni 



x.a 



Prescribe medium 
to al low act ions 



XI • a 



from 



A. 

I 



< ell 



(' "<l< 



11.5 



I 

' 118 



NO DETAILED ANALYSIS FOR* 



SUB-STEP 11.5 



INPUT 




ACTION 




OUTPUT 


Terminal inputs, 
actions, and outputs 
in practice and 
results of learning 


► 


Characterize diffi- 
culties in going 
from entering 
behavior to terminal 




Identification of 
difficulties for 
which assistance is 
necessary 


analys is 




behavior 






i 




i i 




ii i 



*See Step 8 for the analysis of learning difficulties 



from 





1K6 




. 




i V 







_1 
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DETAILED ANALYSIS FOR 



SUB-STEP 11.6 



INPUT 



ACTION 



Ident if ication of 
potent ial learning 
difficulties 



Prescribe types of 
ass i stance to be 
used 



OUTPUT 



Prescription of 
types of cues to be 
used and tyoes of 
response practice 
to be requ i red 

vi 



ON NEXT 5 PAGES 
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from 



11.6 



I V 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


SIMILARITY among 
inputs to be 
di scriminated 


► 


Prescr4be assistance 
to overcome learning 
di ff iculties 


► 


Prescriptions : 

•practice at 
recognit ion level 

-gradual progress ion 
in paired compari- 
sons 

-cu'-s cal 1 ing attcn- 

tion to difrereoccs 
VI .a 


i v.a 




v.a 





LARGE NUMBER OF 
INPUT PROPERTIES 
forming the basis 
for discriminations 




Prescribe assistance 
to overcome learning 
difficulties 

v.b 




Prescrioti ons: 

-gradual increase in 
number of proper- 
ties used 

-cues cal 1 inq atten- 
t ion to al 1 rele- 
vant p opert ies 
(d i agram , statement 
of a /ule) vt 


i v.b 


^ 


► 



LARGE NUMBER OF 
INPU1S to be 
discriminated 

i v.c 




Prescribe assistance 
to overcome learning 
difficulties 

v.c 


► 


Prescriptions : 

-Presentat ion of al I 
inputs simultane- 
ous ly* (big picture 
diagram) 

-cues calling atten- 
tion to differences 

(rules) vi.c 


^ 





^Useful for all discrimination problems 



t 

1 



1 



I I I 



from 






step 


. 11,6 

"f — 




i V 




. 119 




- .A 1 



ryiORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT 




ACT ION 




ouTPyt 


APPARENT 

DISSIMILARITY among 
inouts reauirina 
general i zat ion 


^ 


Prescribe assistance 
to overcome learning 
di f f i cut ty 

• •a 


► 


Prescript ions : 
-create artificial 

representat ions 

Heightening 

simi lar i t ies 
-use cues to cal 1 

attention to 

s imi lar i ty (rul^s) 
VI .a 


i v.a 














LARGE NUMBER OF 
PROPERTIES TO INPUTS 
requi ring 
general ! zat ion 




Prescribe assistance 
to overcome learn inc 
di f f icul ty 

v.b 




Prescriptions : 

-qradual increase in 
number of proper- 
ties used 

-cues calling atten- 
tion to al 1 rele- 
vant properties 
(d i agram, statement 
of a ru le) vi .b 


i v.b 


>- 


► 



LARGE NUMBER OF 
INPUTS requiring 
general i zat ion 

iv.c 




Prescribe assistance 
to overcome learning 
diff icul :/ 

v.c 




Prescriptions : 
-use large number 

of examples 
-use cues to faci 1 i- 
tata transfer to 
examples not used 
in training (rules) 

Vi -C 


► 


► 




I 



er|c 



\ 






► 






► 






1 

1 



\k2 



I 

i 
I 
I 
I 
I 
I 
I 



1 



I 
I 
I 
I 
I 
I 



from 



11.6 



119 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (3) 



INPUT 



ACTION 



OUTPUT 



LARGE NUMBER of 
input-action 
associations to be 




Prescribe assistance 
to overcome learninc 
difficulty 

v.a 




Prescri pt ions : 
-provide cues to 
assist learner to 

i dent i fy whi ch 
action goes wi th 
which Jnput (e.g. , 
mneumon tcs) 

vi .a 


learned 

i V. a 


► 


► 



STRONG EXISTING 
ASSOCIATION between 
input and another 
act i on 

i v« b 




Prescribe assistance 
to overcome learninc 
difficulty 

v.b 


► 


Prescriptions: 

-provide recognition 
practice in which 
two competing 
actions are con- 
trasting options 

-use cues to cal 1 

attention to . ^ 
comoet! tion vi.b 


► 











^ 


1 ^ 1 


► 






ERIC I 
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MORE DETAILED 
DIAGRAM FDR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


LOHG SEQUENCE 
in chain to be 
learned 


► 


Prescribe assistance 
to overcome learn inc 
di f f icul ty 




Prescript ions : 

-break up chain 
into parts 

-decide on forward 
or backward order 
in teaching parts 

-use cues (model 
performance, job 
aids) iLLti 


iv.a 




v.a 


^ 



SIMILARITY AMONG 
OUTPUTS in different 
parts of chain to be 
iearned 


► 


Prescribe assistance 
to overcome learninc 
difficulty 




Prescript ions : 
-provide practice 
in discriminating 
among s imi lar 








► 


outputs 


iv. b 




v.b 




vi .b 



STRONG EXISTING 
ASSOCIATION betv/een 
output (in chjin) 
and another action 

'Ytfi 


► 


Prescribe assistance 
to overcome learninc 
di f f icul ty 

v.c 




Prescriptions; 
-provide practice 

recognizing differ* 

ence between 

alternative actions 
-use cues to prompt 

correct action 

vi .c 




► 




ERIC 




from 
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DETAILED ANALYSIS FOR 





INPUT 




ACTION 




OUTPUT 


11.7 


Prescription for 
types of assistance 
and practice 


^ 


Plan type of 
preparatory practice 




Descript ion of 
planned preparatory 
pract i ce 


vi i 











ON NEXT 3 PAGES 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (D 



''<PUT ACTION OUTPUT 



For each objective 
in lesson uni t : 


^ 


Plan type of 
assistance and type 
of respond ing 

vi i i .a 




Plan cal 1 inq for : 
^maximal cuing 

strength 
-eas iest form of 

respond ing ^e.g. , 

recogn i t ion) 

ix.a 


Initial practice 

vi i .a 












Plan type of 




Intermed iate 




assistance and type 




practice 




of responcMng 






► 






V 1 i • b 




vi i i .b 


1 



Plan cal I ing for : 
--gradually weakened 
cues 

-harder forms of 
responding (e.g. , 
editing) 

ix.b 



Terminal practice 


► 


Plan type of 
assistance and type 
of responding 




Plan cal 1 ing for: 
-final ly , no cues 
-hardest form of 

responding (e.g. , 

product ion) 

ix.c 




► 




ERIC 




146 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (2) 



INPUT 




ACTION 




OUTPUT 


For each **input- 
action-output'* unit 
for an objective: 




Schedule practice 




Scheduled \st 


OUTPUTS to be 
discriminated or 
requi r ing 

aeneralization vi i.a 


^ 











V i i i .a 




i X . a 












INPUTS to be 
discriminated or 
requi r ing 
discrimination 




Schedule pract tee 




Scheduled 2nd 


► 




► 




vi i.b 




V i i i .b 




ix.b 



INPUT-ACTION 




Schedule practice 




Scheduled 3rd 


associations to be 










formed 






^ 




vi i . c 


► 


vi i i .c 




ix. c 



o 

ERIC 
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1 
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from 



step 


11.7 


cell 


vi i 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (3) 



INPUT ACTION OUTPUT 



Ob j e ct i ve i n vo 1 ves 
multiple ''input- 
act ion-output*' units 
in a PROCEDURAL or 
MOTOR chain 

vi i .a 


► 


Schedule sequence 
of units to be 
practiced 

vi i i .a 




Schedule cal 1 ing 
for units to be 
taught in a backwarc 


order* 

Ix.a 




► 



Object i ve involves 
multiple "input- 
action-output*' units 
in a CONCEPTUAL 
chain (e.g. » stat ing 
a principle) 
vi i-b 



Schedule sequence 
of units to be 
practiced 

vi i i .b 




Schedule practice 
for: 

-non-hierarchical ly 
related concepts 
in any order 

-hierarch ical ly 
related concepts 
(lower concept 
first) ix.b 


► 



*There are theoretical reasons for this recommendation; there are as 
insufficient data supporting a forward or backward order. 



yet 






from 



step 


11.8 


1 cell 




1 


119 



NO DETAILED ANALYSIS FOR 



JB-5TEP 

n.8* 



INPUT 



ACTION 



Description of 




Describe media 




planned preparatory 




requirements for 




pract ice 




preparatory practice 


1 


X 


► 


xi 





OUTPUT 



Media prescriptions 



XI I 



*Comparable to Sub-step JJ^» page 129> 



I 



149 





n.9 


loii 




j 


119 



I 
I 

\ 

I 
I 

I 
I 

SUB-STEP 11.9 

I ~ 
I 



from 



DETAILED ANALYS'S FOR 



INPUT 




ACTION 




OUTPUT 


Descriptions of 
terminal practice 
and preparatorv 
practice 

i 


► 


Characterize 
potential problems 
in attending or 
observing behavior 

ii 




Characterization of 
to what (and when) 
attention or obser- 
vation needs to be 






drawn 

« « * 

1 1 1 



i 

I 
I 
I 
I 
I 
I 



ON NEXT I PAGE 



ERIC 
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from 
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cell 
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page 
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MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT ACTION OUTPUT 



Symbol ic materials 
to read (e.g. , on a 
page or sequence of 
pages ^ 

i .a 


• 


Characterize 
attending or 
observing problems 

• • 




Characterize 
problems of: 
-what to read 
-hov/ much to read 
- i n what sequence 

to read 
-what to do when 

finished iij.a 


► 


► 



Symbol ic materials 




Characterize 




Characterize 


to listen to 




attending or 




problems of: 






observing problems 




-when to start 










1 istening 









► 


-how long to I isten 


i.b 




i i .b 




i i i •b 



Non-symbol ic 
materials to observe 

i .c 


► 


Characterize 
attending or 
observing problems 

i i .c 




Characterize 
problems of: 
-what to look at 
-how much of i t to 

look at 
-in what sequence tc 

look at various 

parts 
-what to do when 

finished 

1 M .c 




► 










Non-symbol ic 
materials to 
manipulate 

i.d 


► 


Characterize 
attending or 
observing problems 

ii.d 




Characterize 
problems of: 
-what 4.0 manipulate 
-what to do when 
finished 

i i i .d 




► 



from 



step 


n.io 








119 
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I 

I 



B-STEP 
11.10 



INPUT 



DETAILED ANALYSIS FOR 
ACTION 



Characterization of 
attention and 
observation problems 

iv 


► 


Prescribe solutions 





OUTPUT 



Prescription of 
cues that can el f cii 
attention or obser 
vat ion 



I 
I 



ON NEXT 1 PAGE 



I 



from 



step 


11.10 


ceii 


iv 


page 


119 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS 



INPUT 




ACTION 




OUTPUT 


WHAT to attend, 
observe, or 
man ipu late 


► 


Prescribe solutions 




Prescript ions : 

^advance organizers 
(e.g. 9 statement 
of objectives, 
instructions) 

-cues, labels, 
symbols 

vi .a 


iv.a 




v.a 


► 



WHEN to attend, 
observe, or 
manipulate 


► 


Prescribe solutions 




Prescriptions: 

-advance organizers 
(e^g* , instruc- 
tions) 








► 




iv.b 




v»b 




vi .b 



HOW LONG to attend, 
observe, or 
manipulate 


^ 


Prescribe solutions 




Prescript ions : 
-instructions or 

symbols indicating 

••stop" 








► 


1 v.c 




v.c 




vi .c 



SEQUENCE in which 
to attend, observe, 
or manipulate 


► 


Prescribe solutions 




Prescriptions : 
-instructions 
-checkl ists 








► 




iv.d 




v.d 




vi .d 



ERIC 




from 



step 


n. n 
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I 
I 

I 



I5UB-STEP 
11.11* 



NO DETAILED ANALYSIS FOR 



INPUT 


ACTION 


Prescription for 




Prescribe media 


attending cues 




requirements 




► 




vi i 




« • « 

VIM 



OUTPUT 



Prescription for 
media requirements 
to present cues to 
control attending 
behavior 



IX 



^Comparable to Sub- step 11,4 , page 129^ 



135 



from 



step 


1L12 


cell 




1 P'*9C 


120 



DETAILED ANALYSIS FOR 





INPUT 




ACTION 




OUTPUT 


^UB-STEP 
IKI2 


Post- instructional 
context 




Characterize 
retention and 
transfer problems 


► 


Characterization of 
retent ion and 
transfer problems 


• 

i 


► 






• • • 

1 1 1 



ON NEXT 3 PAGES 
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from 



step 


11.12 


cell 




page 


120 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS da and ib) 



INPUT ACTION OUTPUT 



Performance aid 
avai lable after 
training 


► 


Character i ze 
retention problems 




Characterization: 
less practice 
required durinq 
training; should be 
practice v/i th 
performance aid 








► 


i .a 




i i.a 




• • • _ 
1 M .a 



Performance aid not 
avai lable after 
draining 




Characterize 
retention problems 


^ 


Characterization: 
more practice 
required during 
training; also, 
spaced-out review 




► 






i.b 




ii.b 




iii.b 



Requi rement : 

short term retention 




Characterize 
retention problems 

• * 

1 1 •a 


► 


Characterization: 
retention less 
of a problem (less 
practice needed) 

iii.a 


i •a 


► 





Requi rement : 

long term retention 




Characterize 
retention problems 




Characterization: 
retention more 
of a problem (more 
practice needed) 

ii i.b 


i*b 


► 


ii.b 


► 



ERIC 




from 



step 


11.12 


cell 




page 


120 



MORE DETAILED 
DIAGRAM FOR DiSCRIMINATIONS (2) 



INPUT ACTION OUTPUT 



Class of inputs 
requi ring 
general izat ion is 
large (contains 
many inputs) 

. lid 


► 


Characterize 
transfer problems 

i i .a 




Character izat ion: 
Inefficient to 

sample af i inputs 

i i i .a 




► 



Class of inputs 




Characterize 




Character izat ion: 


requi ring 




transfer problems 




possible to sample 


generalization is 








all inputs in class 


smal 1 










i.b 


► 


i i .b 


► 


• • • u 

1 1 1 .D 






-LS2. 



from 



step 


11.12 


cell 




page 


120 



MORE DETAILED 
DIAGRAM FOR DISCRIMINATIONS (3a and 3b) 



INPUT 




ACTION 




OUTPUT 


Acceptable 
variations in 
actions are many 
in number 


► 


Characterize 
transfer problems 




Character izat ion: 
inefficient to 
sample al 1 actions 


_ L,a-. 






► 


• • • 
1 M .a 



Acceptable 




Characterize 




Characterization: 


variations in 




transfer problems 




possible to sample 


actions are few 








al 1 actions 
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*A summary begins on page 20. 



Previous sections of this report have presented a description of seven 
task flows involved in educational RsO. These include: (1) development, 
(2) diffusion/implementation, (3) research, (4) evaluation, (5) social inter- 
action, (6) management, and (7) ^'dealing with issues/' Much educational R&D 
involves an Intimate mixture of two or more of these diverse activities. 
Nevertheless, an impact can be made on education by training some personnel 
to be able to execute just one complete task flow, by training others to 
execute just part of one task flow, and, to be sure, by training still others 
to execute more than one task flow. In each instance, the prescribed task 
flow represents the terminal performance that is the goal of the proposed 
training program. The function of an instructional strategy is to identify 
the prior learning experience necessary if trainees are to achieve the 
termi na 1 pe r f ormance . 

The purpose of formulating an Instructional strategy may be described 
with the aid of the following diagram. 



entering 




behavior 






► 



intermediate 
behavior 
(learning 
experience) 





terminal 
behavior 


— ► 





The training technologist must prescribe the intermediate behavior (learning 
experience) an educational R&D trainee must exhibit that will help him to 
bridge the gap between his entering behavior and the behavior the technolo- 
gist identifies as terminal. 

Implicit in the use of the word "behavior" In the term "intermediate 
behavior" is the assumption that the trainee learns only what he has prac- 
ticed. The development of the proposed curriculum for educational RSO 
trainees will explicitly rest on that assumption. Accordingly, the major 
portion of the curr iculun wl 1 1 require trainees to practice the very tasks 
identified In the work flows as well as other tasks needed to prepare them 
to do so. Thus, a key training requirement will be that trainees engage In 
active practice. 



Before describing steps taken to formulate detailed strategy decisions, 
some general training considerations (including the decision to use active 
practice) should be described. These considerations apply equally to all 
seven major task flows. 

1. General Training Considerations 

The current behavioral ly oriented instructional technology prescribes, 
and this report proposes the use of, the following instructional operations 
as a means of achieving learning effectiveness and efficiency: (a) provid- 
ing for active responding; (b) se' . ting responsv^s to be practiced on the 
basis of behavioral analysis of tasks; (c) prompting response practice; 
(d) providing feedback; (e) individualizing practice opportunities; and 
(f) providing for transfer. Each of these operations, and its implications 
for the proposed curriculum, will be discussed in turn. 

a* Providing for active responding . Training development efforts 
in industry and in the military provide a model for the develop- 
ment of the educational R&D curriculum. In such efforts, 
trainees practice the very behaviors (in appropriate contexts) 
that they are expected to exhibit after training. They do not 
spend major portions of training time engaged in practice ver" 
balizing about the behaviors expected of them. Only to the 
extent that it can facilitate the acquisition, retention, or 
transfer of terminal behaviors is verbal practice required of 
them. 

In the proposed curriculum, some trainees will be trained to 
**deal with issues,'* which a verbal performance. Only these 
trainees will, in addition to practicing the procedural behaviors 
involved in "dealing with issues,** intensively engage in the 
kind of verbal practice required to acquire knowledge of educa- 
tional R&O issues. All other trainees (e.g., at the assistant 
or at the technician level) will engage in verbal practice only 
to the extent that it can facilitate their learning to perform 
the procedural tasks involved in the various task flows. Speci- 
fically, it is anticipated that this is likely to be the case 
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when trainees are to be trained to be able to transfer what 
they have learned to a variety of situations* Otherwise, they 
will concentrate on practice of the actual behaviors involved 
in the task flows they are to master. In practice, this will 
mean concentrating on task flows in specially prepared labora- 
tory settings or in realistic intern settings. 

Concentration on active practice represents a departure from 
traditional instruction in education. Concentration on the 
practice of the very behaviors required at the end of instruc- 
tion, rather than on principles about those behaviors, repre- 
sents a still greater departure. 

b. Selecting responses to be practiced on the basis of the behavioral 
analysis of tasks . The behavioral analysis of tasks, that is 
to say, the identification of the discriminotions , generaliza- 
tions, and chains involved in task flows, is central to the 
proposed approach to the development of an educational R&D 
curriculum. On the basis of such an analysis, strategy formu- 
lations can, in its prescriptions for active practice, identify: 
(1) the range of practice situations involving terminal perfor- 
mance it must provide; and (2) the types of prior practice 
situations likely to be necessary to prepare trainees to engage 
in the practice of terminal performance tasks. Examples of 
each of these kinds of prescriptions follow. 

(I) Range of "terminal" practice situations . In the development 
process, an R&D person might be faced with instructional 
situations calling for the preparation of practice items 
either at the recognition level, or at the editing level, 
or at the production level. In his training, he must be 
given the opportunity to encounter each of these three 
situations (so that he can make the appropriate discrimina- 
tions). He must also be allowed to encounter multiple 
examples of each situation (so that he can make the appro- 
priate generalizations). The purpose of behavioral analysis 
is to identify these types of situations so that they can be 
sampled by the trainee during his training. 



Ideally, each major type of situation should be encountered 
in isolation from the other types, Just as would be the case 
if the trainee were on the Job* Exposure at one point in 
time to more than one type of situation would provide the 
trainee with cues or prompts that would facilitate the 
required discrimination or generalization. Since no such 
aid is found on the Job, the practice during training that 
IS most like on-the-job performance, i.e., the practice of 
terminal performance, should also offer no such aid. When 
prepared to do so, trainees taking the proposed curriculum 
will be expected to follow a task flow unaided. 

(2) Prior practice of non-terminal types of tasks . Behav i ora I 
analysis serves to identify the prior kind of practice that 
can prepare trainees to engag.e in unaided practice. By 
identifying discriminations that are difficult to make, or 
by identifying conditions under which trainees are likely 
to make generalization errors, or by identifying chains 
(performance sequences) that are likely to produce errors, 
behavioral analysis aids the training technologist to 
formulate the kind of preparatory practice that will avoid 
these possibilities* So, for example, he might simultaneously 
present contrasting situations (unlike the terminal perfor- 
mance which contains but one situation) to aid the trainee to 
make the necessary discrimination. In the case of selecting 
the appropriate mode of response, the trainee might be faced 
with two situations (to be discriminated), one calling for 
recognition responses, the other calling for production 
responses. 

Behavioral analysis serves to identify learning tasks that 
may prove difficult and for which the training technologist 
must formulate a strategy prescribing the kind of preparatory 
practice that enables the trainee to engage in terminal per- 
formance. 



c. Prompting response practice . Trainees cannot be expected to 
practice terminal tasks or preparatory, non-terminal tasks 
correctly without some form of initial cuing or prompting. 
Such initial assistance may simply consist of a model demon- 
stration immediately imitated by the trainee. Or, it may 
consist of a highly detailed checklist which he can refer to 
as he precedes step by step through any of the R&D tasks. 
Whatever form cues or prompts may take, it is axiomatic that, 
in the interest of instructional, and hence learning, effi- 
ciency, the trainee only be given as little assistance as is 
needed to produce the desired performance. It is also 
axiomatic that assistance ultimately be totally withdrawn and 
that it be withdrawn as soon as the trainee can perform without 

it. 

The value of active practice does not derive simply fron the 
fact that a trainee has simply practiced a response. It 
derives from the fact that, at some point in training, the 
earlier the better, he has practiced a response in terminal 
contexts identical with those he will encounter on the job. 
This means practice without the aid of cues or prompts. Cues 
and prompts, of whatever description (some are listed below), 
serve to reduce the likelihood that the trainee will make errors 
early in training which he will subsequently have to unlearn. 
They also serve, when they are carefully chosen and when they 
are withdrawn gradual ly , to prepare him to perform a; the end 
of training without their aid. Thus, strategies must not only 
identify what type of assistance to provide and when to provide; 
they must also identify when and how to fade out their use. 

Assistance can be provided the learner in a variety of ways. 
Some of the ways to be considered for use in the proposed 
curriculum are listed or exemplified below. 



— Types of cues provided 

- Demons t rat ion of a target performance 

-Presentation of advance organizers 
(e.g., statements of objectives) 

-The use of diagrams to cue responding 
(e.g., diagrammatic representation f the behavioral 
analysis of a task) 

-AlteraLion of stimulus mode 
(e.g. y use of visual or concrete example rather than a 
verbal or abstract example) 

-Controlling the sequence of stimulus mode presentation 
(e.g., concrete before abstract) 

— Degree of cuing and timing of its withdrawal 

-(See above) 

— Magnitude of responses practiced 

-Reducing the magnitude of a task practiced at any given 
moment (i.e., reducing the operant span) 

— Hode of responses practiced 

-Requiring a less difficult mode of response 

(e.g., requiring recognition rather than production practice) 

"Sequencing mode of response to progress froi, easiest to 
most difficult 

(e.g., recognition, editing, and only then, production) 
"' bequencing of ^asks to be practiced 
-Backward chaining of tasks 
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These various types of assistance can be (and wMl be) used 
individually or in combination. They will be used not only 
to facilitate practice of the terminal performance , but also 
the prior, preparatory practice which itself is designed to 
be a facilitator. The progression of training which uses such 
assistance techniques may be diagrammed as follows. 



Preparatory 
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pract ice 
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— > 
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d. Providing feedback > Feedback about the correctness of a response 
a trainee has just made may occur in one of two ways. The 
trainer can provide it; or, the trainee can provide his own. 
Having had prior training in discriminating between correct and 
incorrect products (stimuli produced by his own responses), the 
correctness of a product thus can provide feedback about the cor* 
rectness of the response which produced it. Perhaps the strongest 
argument in favor of the use of such self-provided feedback is 
that it is precisely the kind of feedback the trainee will require 
when he is on the job. Thus, to the extent that training 
simulates the job, the more likely will transfer to the job occur. 

The argument offered in support of backward chaining as a train- 
ing strategy centers primarily on its feedback capability. Having 
learned the last step in a chain, the learner then learns the next 
to last step and the last step provides him with feedback about 
correctness. Backward chaining is particularly appropriate when 
procedural skills are being taught (e.g., tying a shoe lace, doing 
an experiment, doing long division, etc.). Typically, the chain 
IS viewed in molecular detail so that steps which follow one 
dnotiier (and taught in a backward order) are quite small. In 
the case of long division, the steps taught in a backward order 
are: getting the remainder, subtracting the last product, etc. 
A case can be made for teaching procedural skills, such as those 
as are involved in diffusion or evaluation or research, in a 
backward order but at a more molar level of detail. 



A molar level of detail may be illustrated with major steps in 
the development process 
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Tr ing each of the seven developmental tasks as a major step, 
a strategy being considered in the proposed educational R&D 
curriculum calls for teaching the tasks in a backward order. 
Thus, for example, the trainee would learn first to revise 
instructional materials before learning how to get tryout data 
or how to prepare instructional materials. (It is also possible 
to teach the detailed tasks within each of the seven major tasks 
in a similar, backward order.) Having learned to perform a 
consequent task, the treinee can provide his own feedback about 
the correctness of the just prior task. 

Another major advantage of this backward order (other than the 
feedback it provides) not usually discussed is the repeated 
exposure of the learner to the practical and concrete contexts 
in which each major task is being performed. In the proposed 
approach, in teaching a trainee to perform task #7, he would be 
presented with pre-prepared products of tasks #1-6. He would 
be expected to perform task #7 (with whatever assistance might 
be necessary). By the time he is ready to learn to perform 
task ffk (formulating instructional strategies), the program 
will have presented him with a wide range of instructional 
strategies. In addition, their relationships to the major tasks 
both preceding and following will have been amply demonstrated. 
Learning how to formulate one's own strategies should proceed 
more effectively and efficiently. The backward chaining approach 
not only provides feedback; it also provides prompting (see 
previous section) which facilitates the learning of tasks early 
O In the chain. In a w.^d, it encourages the trainee's "modeling'* 

u^^ta behavior. 8 



e. Individualizing practice opportunities . It is proposed that 
the learning experience trainees undergo to achieve the same 
training goal (e.g., project director in curriculum develop- 
ment) be individualized. (Training for different goals, e.g., 
diffusion or evaluation, will obviously require some differing 
learning experiences). It is proposed that all trainees seeking 
the same training goal also be required to undergo a fixed (non- 
individualized) core curriculum. A rationale for and the impli- 
cations of each recommendation will follow a description of ways 
in which learning experiences are individualized and those that 
are unvarying may be beneficial for educational RSD trainees. 

(I) A core curriculum . For each of the major training programs 
(e.g., a curriculum development program or a diffusion/ 
implementation program), it is proposed that a core curricu- 
lum be developed. The core would train trainees to perform 
all the procedures or tasks involved in these functions 
covered by the programs (e.g., how to develop a curriculum). 
Training beyond the core would consist either of additional 
and more intensive practice in the very same tasks covered 
by the core or of specialization in a more circumscribed 
set of tasks (e.g., formulating objectives, or constructing 
test items, or preparing instructional materials, etc.). 
For those train*es being trained to deal with conceptual 
issues, additional training will concentrate on courses 
devoted to issues (e.g., problems in formulating instruc- 
tional strategies). 

It is proposed that all personnel within a given program 
(e.g., curriculum development), no matter what their level 
of specialization, from technician to project director, 
take the same core program. It is also proposed that they 
all take the core for the other programs (e.g., for diffu- 
sion/implementation). The advantages stemming from this 
approach are seen as follows. Trainees completing such 
core mater iai s will: 



— Be capable of becoming switch hitters with further 
training should this be necessary 

— Be capable of specializing in other functions at a 
later date 

— Be capable of communicating and cooperating with 
other personnel at differing levels of specializa- 
tion wi thin their own func ion 

— Be capable of communicating and cooperating with 
personnel in other functions. 

(2) An individualized curriculum . Training can be individualized 
on the basis of the trainees' own decisions and choices and 
on the basis of what trainers decide. (Administering fixed, 
core materials is obviously a trainer, not a trainee, 
decision.) Decisions can concern: what kind of training to 
receive, how much to receive, what alternative paths to take, 
how long training should last (or how fast it should proceed) • 
Pre-training results on screening tests, trainee goals and 
preferences, and rational decisions about effective paths to 
achieve training goals can all jointly contribute to design- 
ing individualized programs for each trainee. So designed, 
programs are more likely to maintain trainee motivation and 
to insure training effectiveness. 

f. Providing for transfer . Arranging practice conditions that will 
facilitate transfer to the on-the-job situation is relatively 
easy to prescribe. Provide practice opportunities that sample 
all the relevant contexts and relevant responses to them; and, 
in addition, make the sample varied and large. The purpose of 
using laboratory exercises or work in Intern settings is to 
provide a sufficient amount and a sufficient variety of examples 
that will not only assure a high level of proficiency but also 
the transfer of the skills that comprise it to the range of 
situations likely to occur on the job. 
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2. Five Key Strategy Decisions for Achieving Five Training Goals 



Strategy decisions are concerned primarily with ways to achieve five 
major goals, goals which appear in the left-hand most column of Table 1 
appearing on the next page. These goals include: (a) trainee acquisition 
of relevant skills involved in terminal performance; (b) trainee acquisition 
of component skills that prepare the way for terminal performance; (c) 
trainee retention and transfer of terminal skills; (d) assuring trainee 
attention and observation during training to permit all of the first three 
goals; and (e) assuring that trainees will exhibit skills they have acquired. 

To achieve these training goals, the trainer must specify relevant 
responses to be practiced, the stimulus contexts in which they are to be 
practiced, the stimulus cues that make possible response practice which is 
correct, stimuli that can serve as reinforcers, and finally, media that 
allow for practice of relevant responses and presentation of relevant 
stimuli. These specifications will be described briefly for each of the 
training goals--as they apply to the proposed curriculum. 

a. Acquisi t ion of terminal skills . The strategy most likely to 
succeed in bringing about the acquisition of terminal skills, 
no matter what type of skill is involved, is the actual prac- 
tice of those skills. Actual practice may, however, be contra- 
indicated for reasons of administrative, logistical, or financial 
unfeasibi 1 ity. Actual practice involving interpersonal relations 
may also be unfeasible if, thereby, the relations may be impaired. 
Therefore, in prescribing what terminal practice should be like, 
the technologist follows these five steps: (1) he characterizes 
the stimuli and responses involved in terminal performances; (2) 
he applies criteria of feasibility in building these elements 
into training; (3) he makes decisions whether to build them in 
or whether to use simulation instead; {k) he selects media that 
can present the decided-upon elements; at I (5) he builds courses 
around these media. 

A tentative application of this process to the proposed curriculum 
appears in Table 2 on page 13. It is tentative because all the 
necessary components of the decision process will become available 
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only during the operational phase of the development effort. 
Table 2, while containing decisions likely to hold up, is 
meant to be illustrative. This can also be said for the 
remaining strategy considerations which follow. 

Table 2 reveals that, because a good deal of the educational 
R&D effort revolves around paper-and-penci 1 solutions to 
instructional problems, it will be possible to concentrate on 
them during training. It is anticipated that at first, paper- 
and-pencil problems will be artificial, in the sense that they 
are prepared specifically for the training setting. To the 
extent that the problems will require all relevant procedural 
operations, they cannot be considered artificial. Later prac- 
tice, in internship settings, will approximate what trainees 
are expected to encounter on the job. 

The sequence of decisions involved in the prescription just 
described is presented in more detail in Table 2. 

b. Acquisition of preparatory skills . In some training situations, 
the trainee can engage in the practice of terminal skills 
immediately following a demonstration of them. In other situ- 
ations, likely to be the case most of the time, the trainee 
needs to engage in some kind of prior, preparatory practice 
before he is ready to engage in the practice of terminal skills 
(terminal skills, once again, meaning performing tasks in a 
task flow as the person would on the job). Preparatory practice 
is apt to be unlike the job and artificial in the sense that it: 
(I) concentrates on components of terminal skills (e.g., dis- 
criminations, generalizations, or chains); (2) deals with the 
components in a specialized, non-joblike way (e.g., teaches 
discriminations using paired comparisons); and (3) makes heavy 
use of techniques to cue or prompt performance. The primary 
purpose of such artificial treatment of job tasks is to prepare 
the trainee ultimately to be able to perform job tasks without 
any art if i cial aid. 
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Prescribing for preparatory practice requires that the tecfi- 
nologist: (I) characterize the nature of the learning difficul- 
ties that may prevent the correct practice of terminal skills 
(e.g., difficult discriminations or generalizations); (2) pre- 
scribe training techniques to overcome such difficulties; (3) 
characterize practice that uses such techniques; {k) identify 
media that make such practice possible; and (5) characterize the 
courses that are built around such media utilization. 

Table 3 summarizes this five-step procedure--as it applies to 
the development of the proposed curriculum. Again, in the 
absence of complete data to support necessary decisions, the 
o'"escription is merely illustrative. 

Pron Table 3, it appears that specifications for preparatory 
practice are likely to share common elements with those for 
terminal practice. Paper-and-pencI 1 exercises are likely to 
accomplish the bulk of the goal of facilitating the learning 
of component discriminations, generalizations, and chains. 
Practice in internship settings are not likely to be sufficiently 
artificial (i.e., specially designed) to provide the kind of 
practice necessary to overcome learning difficulties associated 
with the acquisition of relevant discriminations, generalizations, 
and chains. Therefore, it is proposed that the bulk of the re- 
quired preparatory practice be accompl ished by means of core 
programs (probably paper-and-penci 1 programmed texts) administered 
early in training. 

c. Retaining and transfering terminal skills . An illustrative 
prescription is offered in Table h for the type of practice 
likely to be necessary to assure that trainees will retain the 
skills they have learned and will also transfer them to whatever 
new (unsampled in tr. ining) situations they will encounter on 
the job. In effect, the prescription recommends for purposes of 
retention additional practice of terminal skills (e.g., in 
internship settings) and for purposes of transfer, varied prac- 
tice opportunities (e.g., both in paper-and-penc i 1 practice and 
in practice in internship settings)* 
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d. Attending and observing during both terminal and preparatory 
pract ice . Trainees cannot engage in effective terminal or 
preparatory practice unless they attend to the right stimulus 
materials at the right time and in the right sequence. Addi- 
tional stimulus materials must be introduced which can elicit 
and control such attending behavior. Candidates for such 
functions include: statements of objectives, diagrams, 
numbered steps, instructions, etc. Some illustrative recom- 
mendations for the proposed curriculum (and the process for 
arriving at them) are presented in Table 5. 

e. Exhi bi t in^ terminal skills on the job . The four training 
goals just discussed are all concerned with instructional 
techniques and operations designed to see to it that trainees 
can acquire, retain, or transfer R&D skills. Having acquired 
the skills is no guarantee that trainees will put them to 
work. Still other techniques are required to guarantee that. 

Suitable contingencies of reinforcement must be identified 
that will insure that: (a) trainees will engage in practice 
necessary for the acquisition of skills; and (b) trainees will 
exhibit those skills beyond the training setting. During 
training, such extrinsic reinforcers as grades, degrees, 
prospects of landing jobs or of advancing on jobs can be ex- 
pected to reinforce trainee practice of skills. Not least 
among potential extrinsic reinforcers are stipends. 

Intrinsic reinforcers are somewhat more difficult to arrange, 
partly because of individual differences among trainees, but 
mainiy because they are inherently difficult to identify and 
control. Training can be made '^interest ing** by providing 
practice tasks similar to those job tasks found in a person's 
job or generally by selecting tasks that arouse curiosity or 
require ingenuity, innovation, or creativity. Intrinsic rein- 
forcement can also be arranged by allowing trainees to experi- 
ence a sense of accomplishment with practical problems in 
internship settings. Also within those settings, professional 
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performance by experts a^ter which trainees can model their ov/n 
performance may contribute to the pool of intrinsic reinforcers. 
And it is precisely this kind of reinforcement which may carry 
over to the Job setting and maintain the skills practiced during 
training. (No table is presented for this training goal,) 
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3> Siirnmary and Elaboration 

The preceding discussion has identified the mojor steps involved in 
strategy formulation and has also provided formulations applicable to the 
proposed curriculum. To the extent that the data base for those formulations 
is complete or nearly complete, the formulations can be considered tenable. 
To the extent that the data base can only be completed during the operational 
phase, the formulations should be considered illustrative. 

There are five major concerns in strategy formulation: how to provide 
for the practice of terminal skills (skills actually employed on the job); 
how to provide the kind prior practice needed lo prepare trainees to be 
able to engage in the practice of terminal skills; how to assure trainee 
attention during practice; how to assure trainee retention and transfer of 
skills beyond the training setting; how to assure that trainees, once they 
leave the training setting, will exhibit the skills they have learned and 
can perform. Reconvnendat ions for each of these probl'ims (as they apply to 
the proposed curriculum) follow. 

The educational R&O tasks (development, diffusion/implementation, 
research, evaluation, management, and dealing with issues) are basically 
procedural, problem-solving tasks which deal with symbolic (verbal and 
quantitative) stimuli and responses. Most of these tasks (on the job) 
involve the use of paper-and-penci 1 as media for performing them. PROPOSAL: 

The very same types of symbolic stimuli and responses should be 
used during practice of the procedural, problem-solving tasks. 
Media for learning should also include paper-and-penci 1 activities. 

Early in training, programmed printed materials may be used in 
laboratory- 1 Ike settings. Later, practice of the same terminal 
tasks shofjld continue in internship settings. Practice In both 
settings should be !n sufficient amounts, suitably spaced, and 
with sufficient variety to assure retention and transfer of these 
terminal tasks. 
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The terminal educational RSD tasks (listed above) plus **social inter- 
action*' also contain non-symbolic stimuli (e.g., people, materials, equip- 
ment). It may be administratively, logistical ly, or psychologically costly 
to employ them in the practice of terminal skills. PROPOSAL: 

Early in training, simulation of non-symbolic stimuli may be used 
as a means o^ avoiding unsuppor table costs. Printed case study 
materials should be used for this purpose. Later in training, 
when trainees engage in internship activities, they should be 
allowed to deal with terminal type, non-symbolic stimuli (e.g., 
tryou^t subjects, administrators, slides, TV tape). 

The terminal educational R&D task ''dealing with issues," in addition 
to its procedural components (e.g., writing a paper on "instructional 
strategies"), has a comprehensive knowledge component (e.g., being able to 
identify or to define what an instructional strategy is). PROPOSAL: 

Even for this knowledge component, it is desirable that trainees 
engage in active practice (e.g., identifying or defining terms). 
Programmed materials would be the ideal medium for providing this 
type of practice, licwever, they are not likely to be available 
for the operational phase of this project. In lieu of the ideal, 
conventional lectures, seminars, and/or discussions should be 
used to deal with the "acquisition of knowledge." To the extent 
possible, these conventional mer'^a should be enriched by the 
addition of practice exercises. 

Before trainees can engage in the practice of the terminal skills 
involved in the procedural R£D tasks (see above), they are likely to require 
prior, preparatory practice. Such practice is usually required in most 
training and is usually artificial. It is artificial to the extent that it 
deviates from terminal practice. What makes it artificial is that it deals 
merely with components of terminal skills (i.e., discriminations, generaliza 
tions, and chains); it may deal with the components in a non-terminal way 
(e.g., paired comparisons for practice of discriminations); and *c provides 
prompting not found in terminal practice. Although labeled "artificial," 
it is the kind of learning experience required to take trainees from enter- 
inn proficiency to terminal proficiency. PROPOSAL: 
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Prescribing preparatory practice required the completion of a 
behavioral analysis of terminal tasks (i.e., identification of 
all the discriminations, generalizations, and chains) and an 
Identification of barriers to their acquisition, retention, and 
transfer. Completion of bi>th tasks must await the start of an 
operat ional phase • 

In the absence of a complete data base from which a prescription 
can be derived, it is possible co identify some likely features 
of the preparatory practice likely to be required. Save for those 
tasKS lequiring non-symbolic stimuli (i.e., people and objects), 
preparatory tasks will involve verbal and quantitative stimuli and 
responses. Paper-and-penci 1 exercises will be used (most likely 
in core ^>rograms) to provide the kind of practice that can build 
to terminal performance. Wherever possible, practice exercises 
will rely solely on demonstation followed by terminal performance. 
Only as more prompting is required will it be offered. Whenever 
offered, it will be withdrawn as soon as trainees can perform 
without it. 

Preparatory practice for tasks involving non-symbolic stimuli (i.e., 
people, objects, equipment, etc.), as in terminal practice simula- 
tion, either in verbal case studies or through gaming (e.g., role 
playing) will be used. 

Both during preparatory and terminal practice, a range of techniques 
will be used to insure attending behavior. These will include such 
techniques as: verbal instructions, statement of objectives, 
graphic diagramming techniques^ etc. 

It is possible to design practice opportunities which, if taken, can 
lead to proficiency in RSD tasks. But, trainees may not take the opportuni 
ties. It is also possible for trainees to engage in the required practice 
and to achieve desired levels of proficiency and yet fail to put that pro- 
ficiency to work beyond the training setting. PROPOSAL: 

The R&D curriculum should exploit a broad range of intrinsic and 
extrinsic reinforcers to encourage response practice during train- 
ing. Reinforcers can consist of such conventional rewards as 
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Stipends, grades, or degrees. In internship settings, it can 
consist of such less conventional *Vewards*' as acquisition of 
professional skills, a share in authorship, or a share in pro- 
ducing materials that are accepted and make an irjact. Practice 
exercises can contain problems that are relevant to and of inter* 
est to individual trainees (a selection of problems should be 
possible). 

To further assure post-training exhibition of skills, working 
with professionals in internship settings can provide the occasion 
for trainees to model their own behavior in keeping with an 
admired example. Performing in a manner comparable to that of the 
admired professional can, in turn, become intrinsically reinforc- 
ing. 

Trainees will be expected to perform at different levels of proficiency 
(e.g., technician, professional assistant, or project director) and to inter- 
act with and cooperate with members of a team. Strategy recommendations 
made so far have concerned performance within a single function and have 
been general, disregarding the issue of levels. Recommendations are needed 
for within function differences and for across function cooperation. 
PROPOSAL: 

A core program for each function (e.g., development) should be 
offered all trainees within that function regardless of level. 
This will enable personnel at differing levels with the function: 
to communicate with one another, to understand each other's prob- 
lem and role, and to be eligible for and prepared to acquire 
additional training to move on to other levels. 

Additional traininc beyond the core (which it is proposed consist 
of programmed paper-and-penci 1 materials) consists of additional 
paper-and-penci 1 exercises and simulated games, and finally, 
increasing amounts of internship practice. 

For across function communication and cooperation, it is recom- 
mended that each trainee, as a minimum, take the core program 
for each function. 
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Perhaps, the key difference between the strategy explicitly proposed 
for the R&D training curriculum and the strategy implicit in currently 
available programs Is the emphasis on active practice. The proposed cur- 
riculum will concentrate on the active practice of skills involved in per- 
forming RSD tasks. Unlike existing programs, i % wi 1 1 not stress verbalization 
about those tasks. Only for those trainees who wi 1 1 be required to "deal 
with issues" (e.g., research-oriented personnel or project director types), 
will verbalization about RSD tasks and RSD Issues be prescribed. Even here, 
practice will be the order of the day. Simply reading about issues is not 
enough. For trainees to put their training (whether in tasks or in issues) 
into practice, they must have the opportunity during training actively to 
do thei r thing. 
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AN APPROACH TO SPECIFYING TRAINING UNITS ASSOCIATED WITH TASKS 
IN THE DDU/ER WORK FLOWS. THESE ILLUSTRATIONS INVOLVE TASKS 
1-3 and 17 IN THE WORK FLOW FOR DEVELOPMENT: CURRICULUI^ OR 
TRAINING PROGRAMS. (PREPARED BY GLEN HEATHERS) 



DEVELOPMENT A: CURRICULUM OR TRAINING PROGRAMS 



Task 1: Identify curriculum or training need 

a. Specify desirable features for curricula in the areas: 



(1) re learning goals MEDIA 

Unit on defining types of learning goals (see R&D Programed 
Foundations task list. Task 13) 



Unit on relations of types of learning, goals to 
individual/societal values: content, process, and 
personal/social goals 

Unit on bases for establishing the set of learning 
goals for a new curriculum 

Unit on examining taxonomies of learning goals 

Unit on ''readings in educational values" 



Seminar/ 
Syllabus 



Programed/ 
Simulated 

Syllabus 

Syllabus/ 
Seminar 



(2) re instructional approaches 



Unit on learning theory in relation to instruction Syllabus/ 

(see R&D Foundations task list. Task 14) Seminar 

Unit on how curricula can take account of different Syllal^ns/ 

instructional approaches as related to designated Seminar 
learning goals 

(3) re provisions for student differences 



Unit describing how curricula can take account of 
student differences in background, interests, 
purposes, learning "styles, '* study competencies, etc. 

(A) re provisions for facilitating implementation 

Unit on how curricular materials can facilitate Syllabus/ 
implementation: diagnostic and achievement testv. Programed 
programed learning units, syllabi, teacher guides 



Syllabus/ 
Lab 



b. Examine and evaluate current curricula in the 
area in terms of the above criteria. 

Unit presenting the analysis and evaluation of a 

curriculum in terms of the A types of criteria: a (l)-(A) 

Unit calling for employing the above model of analysis 
and evaluation with a set of curricular materials 

c. Identify shortcomings of current curricula in the area 

Unit providing method of identifying leading curricula, a 
chart form for comparing curricula selected for analvsis, 
and a summary procedure for indicating major short- 
comings in existing curricula 

Task 2; Decide to conduct (or not conduct) the development effort 

a. Judgments of importance 

Unit presenting criteria of importance, method of measuring Programed/ 
identified curriculum shortcomings against the criteria. Syllabus 
and method of arriving at summary judgnent of importance 
of engaging in a curriculum development effort 

b. Judgments of feasibility 

Unit presenting way of identifying available resources '''Programed/ 
(funds, personnel, support, etc.)» of evaluating Syllabus 
resources against requirements of the development effort, 
and of judging feasibility 

Task 3r Specify major features of the curriculum to be developed 

a. Provisions for classes of learning goals 

Unit on selecting classes of learning goals for che nev; 
curriculum that builds on units above and offers trainee 
systematic approach to examining relevance of different 
classes of goals and to placing emphasis on goals judged 
to ha^a highest relevance. 

Unit providing trainee with a set of general purposes that 
a designated curriculum is to serve with sttidents; 
trainee Is called upon to generate a set of types of 
learning goals he judges will satisfy these purposes 

b. Provisions for instructional approaches 



^TDTA 

Programed 
Lab 

Proeramed/ 
Svllabus/ 
Lab 



Progrnnied 



Lab 

(Simulntion) 



Unit teaching trainee to judge relevance of different 
instructional approaches to the accomplishment of 
different types of learning goals 



Programed/ 
Svllabtjs 
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c. Provisions for student differences 

Unit teaching trainee how variations in instructional Programed/ 
materials and procedures can meet designated individual Simulation 
differences among students and how provisions for such 
variations can be built into the curriculum 

d. Provisions for facilitating implementation 

Unit teaching trainee how diagnostic and achievement Programed/ 
tests, programed learning units, syllabi, teacher Lab 
guides, etc. can assist in curriculum implementation 

a-d Combining provisions a-d 

Unit calling upon trainee to generate a description of Syllabus/ 
the major features of a curriculum he mipjit btiild 1n Lab 
terms of the four types of provisions (a-d above) 



T ask 17: Arr a nge and condu_ct a JijBld_ J:est .under controlled conditions 
a. Specify requirements to be met in the pilot test 
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Unit teaching trainee a set of requirements and how they 
apply to pilot testing an illustrative curriculum 

b. Specify criteria for a pilot test site 

Unit teaching trainee a list of criteria and reasons v/hy 
they are important 

c. Select the pilot te.^t site 

Unit presenting trainee with data on three potential pilot 
test sites for a specified curriculum; trainee applies 
selection criteria, selects one site, and justifies his 
choice 

d. Prepare to initiate the pilot test 

1- Make working agreement with pilot test school 

Unit presenting list of items to be covered in making 
working agreement with the pilot test scbool and 
shot'.'ing in a fll*" Rinulatlon hot; tVey can be covered 
in a planning conference with officials of School X 

^. Assemble ^nd organize the pilot test staff 

Unit presenting requirements for staffinn a pilot test 
at School X and offering a film simulation of a 
conference to plan the membership and organization 
of the pilot test staff 



Programed/ 
Simtilation 



Programed 



Simulated 



Programed/ 
Simtilation 



Programed/ 
Simulation 
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MHDIA 



Simulated 



(3) Train teachers to implement the curriculum 

Unit outlining how to design and conduct a workshop Programed 
to trail* teachers of School X to teach the curriculum 

(A) Obtain pretest data on current instruction in the 
area of the new curriculum at School Y 

Unit presenting simulated data on an assessment of the 
instructional program that is to be replaced by the 
new curriculum 

(5) Make arrangements for introducing the new curriculum 

Unit presenting simulation of arranj^ements (schedules, Simulated 
teaching assignments, etc.) to implement the new 
curriculum at School X 

e. Launch instruction in the new curriculum 

Unit simulating introduction of the curriculum 

f . Monitor instruction, using feedback data to modify 
implementation 

Unit simulating method of gathering implementation data. Simulated 
process of data gathering, data obtained, and ways to 
make use of the data in modifying implementation 

g . Gather data and interpret^ assessing outcomes of the curriculum 

Unit simulating summative assessment of the curriculum as Sinulated 
implemented at School X 



Simulated 
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A STRATEGY FOR TEACHING TASK 9, PREPARE INSTRUCTIONAL 
MATERIALS , IK THE WORK FLOW FOR DEVELOPMENT: CURRICULUM 
OR TRAINING PROGRAMS. (PREPARED BY LAUREN RESNICK) 



What follows is an outline of a set of instructional components that would 
be useful in teaching trainees to prepare instructional materials. Many details 
need to be filled in before instruction could become operational. Places that 
need such elaboration are noted. 

I. A first step is providing a specific definition of the terminal objectives. 
In particular, what is needed is a statement of the ran^e of types of instruc- 
tional materials our trainees should be able to prepare. This specification 
can be made in terns of (at least) the following dimensions: 

A. Type of subjec t matter . Ve can specify standard and non-standard 

curriculum areas. We need, minimally, elementary school reading, math 
and science, and possibly social studies. Also, preschool skills (which 
will cut across traditional subject-matter boundaries), perceptual-motor 
skills, and some aspect of '^creative*' or 'problem-solving" skills (these 
may fall into one of the other subject-matter areas). For the training* 
program emphasis, we can distinguish: tutorial skills, small group irstruc- 
tion skills, classroom management skills, diagnostic skills, lesson pre- 
paration skills (at least). 

Type of media used . These include: pencil and paper, film or video tape, 
audiotape, teacher presentation, peer tutoring, ''manipulative'' materials, 
teaching machines (including computer). 

C. T ype of inst ruction. "Prescriptive" (definite specifiable terminal behavior, 
directed use of materials, clear evaluation of responses, sequenced); 
"exploratory" (relatively unsequenced thus permitting greater choice to 
student, at least some use of materials is "open-ended"; there is not a 
specific right ansv7er is every case, student gets to pose at least some of 
the questions) . 

D. Psychological _c lasses^ oj_ h^eA^v^^s ,to_^^^ taught . At the grossest level, 

a distinction c£m''be""m~ade between" verbal "knoxv^ledge" repertoires (in which 
ability to talk about a subject-matter is involved) and "performance'' 
repertoires (which may include some verbalization, but in which the 
criterion is ability to actually carry out some procedure) . At a finer 
level, a variety of categories of behavior have been proposed (e.g., 
Mechner, Gagne) . The following list seems to me to be useful: stimulus- 
discrimination tasks, labelling tasks, concept-attainment tasks, procedures 
(involving relatively extended chains of behavior; both "algorithmic" and 
"heuristic" procedures can be encompassed here and some further distinction 
may be needed), simple chains (e.g., reciting thf> alphabet). 
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Types of Instructi onal sjra^e^j^ used > These should include: stimulus 
fading, use of diagrams and other visuals as cues» verbal prompting, 
simulation, modeling, spacing of practice, both recognition and constructed 
responses, both brief and extended constructed responses, backward chaining, 
different forms of feedback, role playing, etc, 

A project director (PD) level person should have some exposure to instruc- 
tional materials that adequately sample across ail of these dimensions, and he should 
be able actually to prepare materials of several types in each dimension- A complete 
sampling may even be possible, since the five dimensions outlined are not completelv 
uncorrected, and a relatively limited set of problems might be adequate to expose 
him to all of the types of instructional problems outlined. The aim would be as wide 
an exposure as possible; limits on reaching this aim can only be established as wc 
begin to actually select and try the problems to be worked on (see below), 

A professional assistant (PA) level person might specialize somewhat more, 
particularly with respect to dimensions A, B and C, Probably, they should samnle 
completely with respect to dimensions D and E. 

A technical assistant (TA) level person could become quite highly specialized, 
although dimensions D and K would probably have to be pretty heavily sampled if ve 
wanted to have any transfer from task to task on the job. 



II. A four-component instructional program would be offere<l. It does not seem feasible 
to completely separate training on preparing instructional materials from consid- 
eration of instructional strategies (Step 8 in the work flow) and fron subject- 
testing and revising instructional materials (Steps 10 and 11). 

A* Seminar on the t heory of instructional or lesson design . This seminar would be 
for PD level people, although some PA people who chose to specialize very heavily 
in designing and building programs might also participate. Approximately 15 
class hours, plus reading and possibly paper-writing time* Focus would be on 
the technical literature relevant to instruction design. A reading list needs 
to be developed. Some suggestions for inclusion are: Machner; liively and 
Sidman on errorless learning with humans; Gagne, Staats, Resnick on programing 
complex intellectual skills and on programing social studies: Glaser on concent 
learning and many other topics; Moore on responsive environments; Margulies and 
Markle, et. al. on prograir,ing strategies; Gropper on use of visuals; Suchran 
and others on "discovery'* or "inquiry" teaching; Skinner; Rruner. 

B. Seminar on the analy sis of^instru^tiojn^aljn^ This \.70uld be for both PD 

and PA level people. About 15 hours of class time plu<; preparation tine 
are envisaged. This would involve looking intensively a number of san] js 
of instructional materials. The materials studied woulc be both '^courses* 
(e.g., AAAS Science; McGraw-Hill Programed Reading; some of IZSS^s science 
lesson series; Nuffield mathematics) and individual lessons or units from 
larger courses. Ke uould try to sample across all of the dimensions outlined 
in Section I. Analysis of instructional materials v;ould be in termf5 of the 
following types of questions: 



1. What is being taught. That is, without looking at the statement of 
objectives, but only at the materials and teachers' manuals thenselves, 
state what kinds ct performances students going through the materials 
could be expected co demonstrate. 

2. Classification of what is taught — into one or nore of the p /cholo^ical 
categories listed in I-D. 

3. Description of instructional strategies, both in general terms, and 
finding examples of each of the types of strategies listed in T-K. 

A. Analysis of media use. V/hat job is being d'^ne by the various media 
used (job includes: setting of tasks, giving instructions, presenting 
information, motivation and maintenance of attention, feedback to the 
student, feedback to the teacher or instructional designer, simulation, 
modeling, etc.)? Are the various media used to full advantage? Are 
thev Integrated with one another? 

Setting up this segment of the training program would involve 
selecting the instructional materials to be analyzed and getting 
enough copies of them; and developing some kind of semi-structured 
materials review form that x/ould guide students in their analysis. 

This seminar would serve to expose students to a wide range of 
existing programs, and also give them an analytic tool which might be 
used in evaluating existing materials for p;ssible use in educational 
programs. For this reason it might be of interest to some poeple spec- 
ializing in design of learning environments or in implementation. 



Laboratory in the editi ng of instructional mate rials . This is for all 
levels of trainees, including TA. It involves lab work ("exercises*') 
followed by group discussions in which students compare their solutions 
to various problems and discuss them with the instructor. Some exercises 
might be done by groups of students rather than individually (on the 
architectural training model)* There shovld be two phases, representing 
greater and lesser degrees of "guidance*' in the editing of naterials: 

1. Trainee is given a statement of objectives (possibly terminal test 
^.tems as well, v/here appropriate) together with the material to be 
edited. He is also given information from subject trials of the 
materials and/or of test data from subjects who used the materials. 
The trainee's job is to revise the materials (or outline desired 
revisions where expensive media do not permit actual revision)* He 
must give the rationale for his revisions and defend these in group 
discussions. 

2. Trainee is given statement of objectives and material to be edited, 
but no subject-test data. He must now revise on the basis of his 
assessment of how successful the materials are likely to be. As 
before, in discussion sessions, he will be asked to justifv his 
revisions. 



A possible addition to the discussion sessions is to have tr.iinees 
actually conduct subject tests of their revised products and suer.e-^t 
further revisions based on results. 

Many of the exercises for t^ii^ coi ponent can >c built around :>ii'^*f'J^ 
of ongoing work in LRDC and other members of the consortivim. It would 
take a couple of years of experience and revision before we put toe<»tr,or 
a really efficient sat of exercises, but the program could bes:in as earlv 
as September 1971, using whatever we c^n gather or specially prcparo. 
\:e should try to sample widely along the dimensions in Section T, but 
there is room here tor some trainee specializat.^on, especially according, 
to subject matter (dimension I-A) and perhaps dimensions T-B and I-C as 
well. 

D. Labor atory in preparing material's. For all levels of trainees. Ln>>orator^' 
C is a prerequisite. Here trainees will be given objectives and per^MP'^ 
criterion tests, and also (in the early stages for PD and PA people; throupjv 
out for the TA people) an outline of the instructional strategies to 
be used. The job is to prepare the materials. Tvpciallv short-segments 
(the "lesson" level) would be used, leaving longer segments for the 
internship. There should be a sampling across the dimensions in Section I, 
especially dimensions I-D and I-K (the first three dimensions would 
permit some trainee specialization). 

Where possible, we would use tasks actually under development at LRDC 
or elsewhere in the consortium. 

There would be some "core" exercises for all trainees. The trainees 
wou]d then meet to compare and discuss results with the instructor. 
Other exercises would be prepared only by students specializing in a 
particular ar'i. The trainees would edit each other's work prior to 
grou;* discuss-ons with the instructor. 

L. In ternship . This cot^ld probabl** run concurrently with the above training 
components for PD and PA, but ^t come until after components C and I) were 
completed (or nearly s^jcx) for TA. 
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Enclosed are illustutive materials taken from a progran beino 
developed for training personnel to develop their own curricula or their 
own training program:. 

The illustrative materials appear in the opening section of a job aid 
which hdS been designed. for use by trainees after they have completed the 
program. Supplemented by adjunct materials, the job aid will also be used 
during training. While learning to develop curricula, trainees will be 
given special guidance in using the job aid. Thus, the job aid will serve 
'two key functions:^ (1) to facilitate trainee learning of the curriculum 
development process; and (2) to serve as a re<-erpncc source once trainees 
are on the job developing their own curricula. 

Key features of the job aid include: 

(1) The use of nn "identification matrix" to help the trainee 
discriminate between conditions in the development process 
which require differential treatment; 

(2) The use of a "decision matrix" to help the trainee to 
associate the appropriate treatment with a relevant condition; 

(3) The U5P of a "standards matrix" to help the trainee discriminate 
between different outcomes based on the treatment he has used or to 
discriminate between right and wrong outcomes; and 

(A) The use of pre-prepared forms to guide the trainees' performance 
both during training and later on the job. 

These key features have been designed to facilitate trainee acquisition 
during training of key skills in the development process and to facilitate 
trainee retention and transfer of these same skll.- on the Job. 



TASKS IN THE DEVELOPMENT PROCESS 



A. COLLECT INFORMATION ABOUT TERMINAL BEHAVIOR 

B. ANALYZE INFORMATION ABOUT TERMINAL BEHAVIOR 

C. CREATE AND SEQUENCE LESSON UNITS FOR TEACHING TERMINAL BEHAVIOR 

D. STATE OBJECTIVES FOR EACH LESSON UNIT 

E. ASSESS SIMULATION NEEDS FOR EACH LESSON UNIT 

F. DEVELOP TESTS FOR EACH LESSON UNIT 

G. FORMULATE INSTRUCTIONAL STRATEGIES 

H. DEVELOP INSTRUCT. JNAL MATERIALS AND PROCEDURES 

J. TRY OUT AND REVISE INSTRUCTIONAL MATERIALS AND PROCEDURES 

J. FIELD TEST INSTRU. lONAL MATERIALS AND PROCEDURES 
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I 

] 

A. COLLECT INFORMATION ABOUT TERMINAL BEHAVIOR 

*H«- A*] Identify the type of terminal behavior to be taught and the 
type of target audience to which it will be taught 

» A,2 Identify methods for obtaining information necessary to 
describe and analyze terminal behavior 

A,3 Select information sources needed to describe and analyze 
termina" behavior 

A,^ Plan the sequence in which information about terminal 

behavioi will be collected! 
A,5 Develop (or plan to use existing) information-collecting 

instruments and procedures 

A,6 Collect and record information 
-rrj^ Illustrative materials are pre?iented for Task:s X^l and 
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STEP 



A.l 



A.l Identify the tyne of terminal behavior to be taught and the type of target 
audience to which it will be taught. 



A. 1.1 



Identify the type{s) of terninal behavior to be tauftht. 



A. 1.2 



Identify the type of target audience to be taught. 
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STEP 



AJ 



OVERVIEW 



INPUT 



ACTION 



OUTPUT 



Plans for curriculum 
or training program 
development 



Identify tyoe of 
terminal behavior and 
type of target audience 



Identification of 
tvpos of termi nal 
behavior and typo 
target audience 



of 



Sub-STEPS 



A.l.l 



Development plans or 




Inspect for presence of 


ccTparable existing 




characteristics indicat 


curriculum or training 




inr. different types of 


program 


► 


terminal behavior 
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/.J. 2 



Development plans 



IV 



Review for characteris- 
tics identif;/inc the 
type of tar(;et audience 




Identification 



-KflOWLFDGF DOMiAIK 




-PKFFORMAIiCE 




-GKNI'PAL COGNITIVE 




SKILLS 




-PERSOKAL/SOCIAL 




BEHAVIOR 


iii 



^age/grade level i 
-socio: jkomic status 
-ethkic/racial back- 
GROurro 

-PHYSICAL/PSYCHOLOGICAL 
DEFICIT 

PAST ACHIEVET-IEKT LEVEL 

vi 




STEP 



A.l 



PAGE INDEX 



A.l.l 



A.l. 2 



TRITFRIA POR 
onl icniM r 1^ n 

IDENTIFYING INPUTS 


ACTION TO BE TAKEN 


STANDARD FOR OUTPUTS 


FORMS TO USE 


-MATRIX: Types of 
termi nal 

behavior . . . • 17 
-Examples . • • • 18 














-MATRIX: Types of 
target 
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DESCRIPTION OF Sub-STEP 



AJJ 



INPUT 



Development plans or 
comparable existing 
curriculum or training 
program 



ION 



Inspect for presence of 
characteristics indicat- 
ing differer^t types of 
terminal cehaviors 



OUTPUT 



Identification of: 

KT;cvLF:;Gr: pcmain 

~PEPFOPVA!;CK 
GENERAL COGNITIVE 
SKILLS 

persoi:al/social 
behavior 
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Job Aid Contents 



CRITERIA FOR 
IDENTIFYING INPUTS 



ACTION TO BE TAKEN STANDARD FOR OUTPUTS 



FORMS TO USE 



-MATRIX: Types of 
terminal 

behavior ••••17 



-Examples of 
terminal 
behavior • < 
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Required Matcrinls 



COMPLETED MATERIALS 



STEP 



COMPLETED FORMS 



BLANK FORMS 



step; 



er|c] 



Sub- STEP AJJ 



INPUT 



Developrient plans or 
ccnparable existing 
curriculurj or trainin; 
progran 



JOB DIAGRAMS 



ACTION 



CUT^U" 



Inspect for presence of 




Ider.t if icat^icn of: 


characteristics indi- 






cating different types 






of tensinal behaviors 










SKILL? 






-Pi:?:3Cr;AL/S0CIAL 






BEHAVIOH 


ii 
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Tharat^tertsttcs oj 

Requirement that 
learner exhi bit 
knowledge of or about 
somethl n9 



I .a 



Ident ify type of 
termi nal behavior 



M .a 



Ident ificGticK c; 



KNOWLEDGE DOMAIN 



t I I « n 



learner do something, 
following procedures 
and resulting in an 
output 

;.b 




Identify type of 
termi nal behavior 

i i .b 

< 


^ 


PERFORMANCE 

< i i «b 


^ 














Requirement that 
learner engage in 
behaviors applicable 
to a wide range of 
si tuat ions 




Identify type of 
terminal behavior 

i i .0 


► 


GENERAL COGNITIVE 
SKILLS 

i 1 i .c 


^ 














Requirement that 
learner exhibit 
behavior that needs 
to be reinforced 
ti. be mainta ined 

i.d 




Identify type of 
ter'ninal behavior 

1 1 .d 
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PERSONAL/SOCIAL 
BEHAVIOR 

1 1 i *d 


► 





O 

< 
X 
LlI 
CO 



>- 

o 



o 
z 



I 'J 



o 



< 

UJ 

o 



2? 
O 

< 



C3 ?^ 
^s: ^ 

s! ;s CJ o 

EH E E 



to ^ 

to r£i 



CO 

o 
to 



I 



I 

J? 

to a 

lO 

,o 

^ 
E o s: 

§3 to 



O 
CO 



CO 



o 
o 

o 

o +^ 
o 



o 

o cc 
o 
\ — 
-J > 
< < 

2 X 

o ^ 

CO CO 



> 

Z OO 

O -J 
o — 

< 



O C 

5 o 



ID c 
c ^ 



u in 
O 

>^ J 01 O 

4-i C 0) 4^ 



c 
c 

0) 

(ACL. 
^ 0) 0) 

O C C C 



4-» O -C 
I/) 4^ 

o cr> — 
c 5 



a> Q*. Q> 



tn — 
u > 

a. a. 
i I 



c c 



c — 



Gl 
O 

' ^ - ' o 
^ CO z o 
I I I I i 



4~« U O 

0)0^0 



f 

E 
0) 

o 

Cl 



>- 
u 
0) 

> 
o 

U I/) <D 
— J- C7> 

C7> 0) > 
C U — 
O CL 

in u Cl 
Cl< 
I 



1/1 



I/) 
c 
o 



I 



^ o 

^ B 

O — 
E 'O 
3 

C7) 4-» 

C CL 

> u 

— L. 

O OJ 

1/1 a. 
I 



t 

u 
o 

D 1- 
— CL 

o 

in &. 
O 

0) (A 
C E 
0) 

C -Q 
O 



1- «n 
Cl 0) 



O 3 

4J -O 



'Si 

SI 



to 



< 

Ol 

o 
u. 
a: 
ill 

CL 



c 

0) 

E 

U in O) 

0) E C 
CL 0) — 

X 4-» 

0) ^ 

c Cl 



V. 

O 

V. 
0) 

a. 
I 



c c • 
> ^ 

0 <U 

CO a: 

1 I 



0) 

C7> C7> 
ID C 
D — 

C D 
ID 

— L. 

o 

ID 

C7> C 
C — 

— 4J 
U 
3 



I I 



4C 
>- 
ID 
1/1 
1/1 
0) 

c 

4J ID 
C 

0) C71 

E r. 

Cl — 

I— 4J 

D — 
t 



< 
Ui 

O 



< 

o 
o 

tii 
O 
o 
ill 
«J 

:5 
o 





en 




o 








i 








X 


o 


UJ 




CD 


CO 




UJ 




a. 


< 




z 
















.'J 







ID 4-» 



I/) 



(/I 

t/) 

0) C 

o — 
c 0 



Cl 

0) *— 

U (/) 0) 
C 0) ^ 
O — ID 
U Cl — 



(D U 
C 



OlU.. 



to 
0) 

14-. > 

i t 



O L. tn 
Cl 0) 
0) JO 

in 

Cl 0) 

E 4-» 
ID ID 
X ^ 

o; 00 
i 



c 

0) 

> 

tn 

C U 

ID 

in <4- 

U tn 
0) 0) 

-Q — 
O O 
i 



in c 

»- E 

O »- 

— O 

a c 
d — 

D 

in in 

m 4-^ 
I- G 

o c 

a> O 
c ^ 

— D 
Q. in 
o 

o i- 

o 

I 



in 
c 
o 

— c 

4-« O 

D C 
O 

Ci 

O V. 

4-« O 

5 

C C7> 

— C 
L. — 

0 4-« 
JZ 4J 

< o 

1 I 



in 



C7^ 

c 



o 

O 

o 

I 



o 

CO 



Co 
I 



en 
ill 

< ^ UJ 

r o -I 
o a. 
I- X 5 
o o < 
Ui CO X 

CO 

to 



ID 

u 
3 

0) 

u 
o 

u 

Cl 

tn 
E 

O 1/1 

(4- 

u in 
0) ID 

a. 4-» 
I 



in 

ID 
Cl 
0) 
u 



I 

0) 

3 
O 



m m 

0 4^0) 
U 4^ 

in 3 ID 
0) -D 1- 
O 0) 
ID 1- Cl 
2: ClO 

1 I 



4J O 

c — 
V in 
E — 
Cl U 
0) 

U tJ 
C7 

0) V) 
E 

in 1- 
O 

O *4- 

O »- 
X 0) 
in CL 
i 



m 
ID 

4J 
0) 

o 

> 

in u 

0) 

in tn 
ID 

4^ (A 

E 

C G 

•— »4- 
03 0) 

E a. 
I 



I 



J3 










in 


0 










0) 






0 




fo 


ur 


4-* 




4-> 








3 








0) 


0) 


0 




in 






u 






0) 




ID 


0 


ID 




L. 




C 








3 


J3 


0 


Cl 


in 




X) 


0 






0) 


0) 


ce 


.—J 


4^ 


0) 




u 




ID 


> 


3 


c 


0 


c 


L. 






ID 


u 


0 




4^ 




E 


Cl 




ID 




in 


L. 




B 




c 


0) 


0 


in 




in 






<4- 


4^ 




0) 


a; 






in 




> 


4-J 


1 


0) 




0 








Cl ^ 


«4- 


0 


ID 



to 

UJ 

CO a! 
O X 



o 



4^ 

CO 



Ci) 
to 



O 
Ci) 

. 

ex. 

Ci) 



CO 



o 
:3 



o 

Ci) 

CO Ci) 
CO ^ 

c:) 

o 
:3 



Ci) 
CO 

I 



to 
to 

Ci) 
Ci) 



i 



A.l.l 

EXAMPLES 


KNOWLEDGE DOMAIN 


PERFORMANCE 


SUBJECT 

HATTER 

AREAS 


-An English student stating rules 

of punctuation 
-A physics student identifying 

variables that need to be 

controlled in an exocriment 
-A biology student classifying 

a frog 

-A math student describing proper- 
ties of a quadratic equation 

-A history stucent listing the 
causes of the C.vil War 


-An English student punctuating 

a sentence 
-A physics student operationally 

controlling the variables in on 

exper iment 
-A biology student dissecting 

a frog 

-A math student factoring a 
quadratic equation 

-A history student doing the 
research needed to identify the 
causes of the Civil War 


JOBS 


-A teacher describing a reinforce- 
ment ochcdule to maintain 
behavior 

-A librarian stating the rules 
for cataloguing books 
A i%iont- c 1 1 no r V/ i n r Hpscribino 

M pi ant bUpcrvi lUi iwiii^ 

techniques for counseling 
subordinates 


-A teacher implementing a rein- 
forcement schedule that maintains 
behavior 

-A librarian actually cataloguing 
books 

-A plant supervisor actually 
counseling subordinates 
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DESCRIPTION OF Sub-STEP 



AJ.2 



INPUT 



Development plans 



ACTION 



Review for characteris- 
tics identifying the 
type of audience 



OUTPUT 



•AGF/GH/vD?: LEVEL 
-SOCIOECOIi'OMIC CTATUS 
-ETHNIC/HACIAL BACK- 
GROUfD 

-PHYSICAL/PSYCHOLOGICAL 
DEFICIT 

■pas:t achievement level 

vi 



Job Aid Contents 



CRITERIA FOR 

IDENTIFYING INPUTS ACTION TO BE TAKEN STANDARD FOR OUTPUTS FORMS TO USE 



-MATRIX: Types of 
target 

audience • • • • 21 









Required Materials 
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COMPLETED MATERIALS 

STEP 


COMPLETED FORMS 

STEP 


BLANK FORMS 
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Sub- STEP A. 1.2 



IfiPUT 



!.'eveiofr.er.t plaiis 



iv 



JOB DIAGR/IM 



ACTION 








Review for characteris- 








tics identifyinf: the 




-S(x:iOKCC!:cy:c 


, . . V o 


type of target audience 




-rrn-NIC/HACIAI. 








GFOU?iD 






► 


-PHYSlCAL/PrYC; 








DKFICIT 








-PAfT ACHTE\'r>!r 




V 






vi 



Target Audiences 







-Grade 




•Work status 






iv.a 



Identify AGE or GRADE 
LEVEL 



v.a 



of Target AudirKrn:^ 



-Preschoolers 

-Pr imary/ secondary 

-High school 

-Col lege 

-Adult' 



vt . a 



-Parental income 
-Residence patterns 
-Parenta 1 occupat i on 

i v.b 




Identify SOCIOECONOMIC 
STATUS 

v.b 


► 


-Di sadvantaged 
-Working class 
-Middle class 
-Urban/'jral 

vi . b 


^ 














-Color 

-Languages used 
-Rel igion 

i v.c 




Identify ETHNIC/RACIAL 
BACKGROUND 

v.c 


► 


-Blacks 

-Spani sh-speaki ng 
-Jev/s, Catholics 

VI .c 


► 














-Phys ical han^ leaps 
-Emot ional handicaps 
-Abi 1 1 ty deviations 

Iv.d 




Identify 

PHYSICAL/PSYCHOLOGICAL 
DEVIATIONS 

v.d 


^ 


-Bl ind 
-Deaf 

-Mental ly retarded 
-Emotionally disturbed 
-Gifted 

vi .d 


► 
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- Schoo 1 performance 
-School completion 
-Record of type of 
training received 
-Interest patterns 
-Test fcores 



t v.e 



* PAST 
.ONAL ACHIEVEMENT 



v.e 



-Over/under achievers 
-Dropouts 
-School graduates 
-Grades received 
-Nature of training 
received 
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STEP 



A.I 



COMPLETION CHECKLIST 



IDENTIFIED 


PERFORMED 


. PRODUCED 


FORMS COMPLETED 


-Types of terminal 
behavior to be 
taught 














-Types of target 
audience to be 
taught 
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STEP 



A.2 



A. 2 Identify methods for obtaining information necessary to describe and analyze 
terminal behavior. 



A. 2,1 Determine whether a model of terminal behavior is available and 

acceptable as a basis for curriculum or training program development. 



A. 2. 2 



Decide on methods for obtaining information needed to describe 
model of terminal behavior. 
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STEP 


A.2 1 


* OVERVIEW 




INPUT 




ACTION 




OUTPUT 


i 




Termincil behavior 
to be taught 




Decide whether an 
acceptable model of the 
terminal behavior is 
available and how to 
obtain a description 
of it 


► 


Plans for obtaining 
a description of 
terminal behavior 


i 


► 





Sub-STEPS 



Available information 
about terminal behavior 
in subject matter areas 
or in jobs 



Decision about model 
availability and 
acceptability for 
terminal behavior to 
be taught 



iv 



Review information f*or 
characteristics indi- 
cating model availabili- 
ty and acceptability 



11 



Make plans for methods 
to use in collecting 
information about 
terminal behavior 



Identification of model 
availability and 
acceptability 
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Identification of 
information-gathering 
techniques to be used: 
VERBAL REPORT 
OBSERVATION 
THEORY GENERATION 
JUDGMENT vi 



STEP 



A.2 



PAGE INDEX 



A.2.1 



CRITERIA FOR 
IDENTIFYING INPUTS 



ACTION TO BE TAKEN STANDARD FOR OUTPUTS 



FORMS TO USE 



-MATRIX: Model 
avai labl I ity . .28 

-MATRIX: Model 
acceptability .29 

-MATRIX: Model 
avai labl I ity and ' 
acceptabi I ity . 

3i 



A.2. 2 



-MATRIX: Selecting 
description 
techniques ... 34 

3b - 37 

-Examples . . . . ^5 



DESCRIPTION OF Sub-STEP 



A. 2.1 



INPUT 




ACTION 




OUTPUT 


•J 




Available infonnation 
about terminal behavior 
in subject matter areas 
or in jobs 

i 




Review information for 
characteristics indicat- 
ing model availability 
and acceptability 

ii 


► 


Identification of nodel 
availability and 
acceptability 






► 
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Job Aid Contents 






CRITERIA FOR 
IDENTIFYING INPUTS 


■ ACTION TO BE TAKEN STANDARD FOR OUTPUTS 


FORMS TO USE 



MATRIX: Model 
aval labi I i ty . .23 

MATRIX: Model 
acceptabi I i ty .29 

MATRIX: Model 
aval labi 1 i ty and 30 
acceptabi 1 ity . 31 



Required Materials 



COMPLETED MATERIALS 

STEP 


COMPLETED FORMS 

STEP 


BLANK FORMS 


Identification of 
type of terminal 
behavior 


A.I.I 
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' Sub-STEP 


A.2.1 


JOB DIAGRAM 

) 


1 


INPUT 


ACTION 


OUTPUT i 
. 1 t 



Available information 
about terminal behavior 
in subject matter areas 
or in jobs 



Reviev information for 
characteristics indicat 
ing model availability 
and acceptability 



11 



Identification of model 
availability and 
acceptability 



111 



Model Specifications 
for Terminal Behavior: 



-Complete 
-Systemat fc 
-i^esult in successful 
outcome 
-Agreed on 



t .a 



Review information to 
see if model meets 
these criteria 



1 1 *a 



Identificatioyi 



Model is ACCEPTABLE 



1 1 1 .a 



Model Sped fi cat ions 
for.Termi nal Behavior: 



- Incomplete 
-Non-systemat ic 
-Do not result in 

successful outcome 
-Not agreed on 



i.b 



Review informat ion to 
see if model meets 
these criteria 



t i • b 



Model is NOT ACCEPTABLE 



i i i • b 



Characteristics of 
Terminal Behavior : 

-Rout Ine 
-Non- complex 
-Man/object 
-Overt 



I .a 



Reviev/ information 
for possession by 
terminal behavior of 
these characteristics 



1 1 .a 




Model more 1 ikely 
to be AVAILABLE and 
ACCEPTABLE 



M I .a 



II 



Characteristics of 
Terminal Behavior : 

- Innovat ive 
-Compl'ex 
-Man /nan 
-Covert 



Kb 



Review informat ion 
for possession by 
terminal behavior of 
these characteristics 



i i *b 



Model more likely 
to be UNAVAILABLE or 
UNACCEPTABLE 



iii.b 
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A.2.1 



CRITERIA FOR DETERMINING THE AVAILABILITY OF 
A MODEL OF TERMINAL BEHAVIOR 



IDENTIFICATION 
MATRIX 



CRITERIA 


• 

exhibited 

--There are prescriptions for the 
terminal hehaoior 


"Terminal behavior is not being 
exhibited 

"There are not prescriptions for 
the terniinal beJuzvior 


MODEL 
AVAILABILITY 


MODEL IS 
AVAILABLE 


MODEL IS NOT 
AVAILABLE 


SUBJECT MATTER 
(SCHOOL) 
EXAMPLES 


E»g. , performing laboratory 

experiments 
E.g., writing book reports 
E.g., listing the advantages and 

disadvantages of a market 

economy 


E.g., developing creative 

solutions to problems 

E.g., cooperating v/i th fellow 

students on a group project 


JOB 
EXAMPLES 


E.g., the expert lathe operator 
exhibits a1 I the required 
steps in using a lathe 

E.g., the expert accountant 

exhibits all the required 
steps in balancing figures 
in a ledger 


E.g., new jobs not yet being 
pe r formed 



ERIC 
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A.2.1 

IDENTIFICATtON 
MATRIX 



[ 



CRITERIA FOR DETERMINING THE ACCEPTABILITY OF 
A MODEL OF TERMINAL BEHAVIOR 



CRITERIA 



t'lodel Specifications 
for Teminal Behavior : 

(1) are complete, comprehensive 

(2) are systematic 

(3) result in a successful outcome 

(4) are aoreed on 



liodel Specifications 
for Terminal Behavior : 

(1) are not complete, comprehensive 

(2) are not systematic 

(3) do not result in a successful 
outcome 

(4) are not agreed on 



MODEL. IS 
ACCEPTABLE 

when all four specifications 
are met 



MODEL IS NOT 
ACCEPTABLE 
when any of the specifications 
are not met , 



doing long division 

The behaviors for doing long 
division are: 

-Completely known 
-Fixed and systematic 
-Lead to a correct answer 
-Arc agreed on by experts 

E.g., wiring lightbulbs and a 
battery in series 

•All four criteria are met 



E.g., exhibiting evidence of 

•'understanding" Ohm*s Law 

-'There is^ agreement as to 
the content of Ohm's Lap 
--There is not^ agreement as 
to hoD "understanding" 
should be expressed 

^Solving for an unknown 
^Writing the equation 
^Verbally describing the 
relations between the 
variables in the equation 



ERIC 




E.g. , teacher management of 

classroom (non-learning) 
behavior (as practiced by 
most teachers): 

The models tend to be: 

-Non-systematic 
-Unsuccessful 

E.g. , sales behavior 

The behaviors tend: 

-Not uniformly to lead to 

success 
-Not to be agreed on 
-Not to be. systematic 
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A.2.1 

IDENTIFICATION 
MATRIX 



CHARACTERISTICS OF TERMINAL BEHAVIOR OETF.K'MNING IVL LIKELIHOOD 
OF ITS MODEL BEING AVAILABLE AND ACCEPTABLE^ 



CHARACTERISTICS 



MODEL 
AVAILABILITY AND 
ACCEPTABILITY 



Ivhen terminal behavior is : 

-Routir.ej fixed set of procedures 
^Ihn^acnplex 

--Involves man/object relations 
-Overt 



yhen ter^ivat hc^'cvior is : 

"Inr.ovativej variable vrcacdurc 
--Conplex 

--Involves man/r.an relaiic':s 
Covert 



MODEL IS MORE LIKELY 
TO BE AVAILABLE AND ACCEPTABLE 



MODEL IS LESS LIKELY 
TO BE AVAILABLE A.ND ACCEPTABLE 



When terminal behavior is 
(one or more of the follov/ing): 

' Routine, involvino fixed set of 
procedures 



e.g. 
e.g. 



"Non-comolex 



EXA/iPLES 



e.g. 
e.g. 

' I nvo 



e.g. 
e.g. 



doing long division 
typi ng 



punctuating a sentence 
mixing paint colors 

Ives man/object relations 



using a lever 
operating equipment 



' Overt behavior 
e.g., wr i 1 1 ng 



When tcrmi nal behavior is 
(one or more of the followino): 

' Creat i ve , i nnovat i vo , invol v i 
alternative set o f orocecurf^s 

e.g., painting an abstract 
e.g., formulating a theory 

" Comp lex 

e.g., practicing psychiatry 
e.g., v/riting an essay 

" Involves man/man rcl a t i on s 

e.g., managing classroom behavior 
e.g., cooperating in a group 
project 

-- Covert behaviors 

e.g. , reading 



^Mixtures of th(he 
aaaept(7ble modeils 



characteristics are possible^ 
arid sometimes not. 



sor^etimes reeultinc i?: available an.l 
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DESCRIPTION OF Sub-STEP 



A. 2. 2 



Decision about model 
availability. and 
acceptability for 
terminal behavior 
to be taught 



Make plans for methods 
to use in coilectin^^; 
information about 
terminal behavior 



11 



] 




Identification of 
information-gathering 
techniques to be used: 
VERBAL REPORT 
OBSERVATION 
THEORY GENFRATIOK 
JUDGMENT 



111 



Job Aid Contents 



CRITERIA FOR 



FORMS TO USE 



lUtNilrYiwo iiMruio 


MATRIX: Selecting 
description 
techniques . 34, 36 

37 

Examples .... 







dent i fi cat ion of 
model avai labil ity 
and acceptabi 1 it> 



COMPLETED MATERIALS 



STEP 



A.2J 



Required Materials 



COMPLETED FORMS 



STEP 



BLANK FORMS 
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Sub-STEP A. 2. 2 



INPUT 



Decision about model 
availability and 
acceptability for 
terninol behavior 
to be taught 



iv 



JOB DIAGRAM 



ACTION 



Make plans for methods 
to use in collecting 
information about 
terminal behavior 



OUTPUT 



Identification of 

information-feathering 

techniques to be used: 

VERBAL REPORT 

OBSERVATION 

THEORY GENERATION 

JUDGMENT 

VI 



Model 
AVAILABLE and 
ACCEPTABLE 



IV. a 



Make vlans: 



■To secure from an 
examplar of the model 
a verbal description 
of terminal behavior 



v.a. 1 



OR 



■To make observations 



of an exemplar 
engag i ng in termi na 1 
behavior 

v>a.2 



Selection of 



Techniaues to he 




-Verbal report 




-Observat ion 






vi .a 



Model 
AVAILABLE but 
UNACCEPTABLE 



i V. b 



ERIC 



■To use theory to 
generate model 
of terminal behavior 



v.b.l 



OR 



■To make ouservations 
of or secure verbal 
descriotions oT 
critical features of 
termi nal behavior 
based on many per- 
formers v« b. 2 



OR 



■To secure judgments 
from experts as to 
what model should be 

v.b.3 



-Theory generation 

-Observation 

-Judgments 



VI .a 



Sub-STEP 1 A. 2.2. I (cont.) 



Model 
UNAVAILABLE 



IV. c 



•To use theory to 
generate model 
of terminal behavior 

v.c 1 



OR 



•To secure judgnients 
from experts as to 
whar model should be 

v.c. 2 



-Theory generation 
-Judgment 



VI .c 



ERIC 



33a 



CHOICE OF INFORMATION-GATHERING TECHNIQUES 
BASED ON MODEL AVAILABILITY AND ACCEPTABILITY 



DECISION 
MATRIX 



CONDITIONS 


Model AVAILABLE and 

ACCEPTABLE 

-Comprehensive 

-Systematic 

-Successful 

-Agreed 


Model AVAILABLE but 
UMCCEPTABLE 
"Incomplete J or 
"NonsyetematiCj or 
"Unsucceeefiilj or 
"Not agreed to 


Model UNAVAILABLE 


ACTION 
TO TAKE 


OBTAIN DESCRIPTION 
OF MODEL 


FORMULATE AND 
DESCRIBE MODEL 


FORMULATE AND 
DESCRIBE MODEL 


SOURCE OF 
MODEL DESCRIPTION 


fl) The total oerfor- 
mance of aii expert 
IS described 


(1) Critical eleme'^ts 
in the performance 
of many people are 
described resulting 
in a total descrip- 
tion of a model 

(2) Theory is used to 
generate a descrip- 
tion of a model* 

(3) Judgments of 
experts are used to 
create a model 


( 1 ) Theory is used to 
generate a descrip- 
tion of a model* 

(2) Judgments of 
experts are used to 
create a model 


SPECIFIC 
TECHNIQUES 
TO USE 

^Theory is pre 


(la) Have the expert 
verbal ly describe 
his own total 
perfo rmance 

(lb) Have an indepen- 
dent observer 
observe and 
verbal ly describe 
the total perfor- 
mance 

^erred to Qiidgmenta when 


(1) Have the performer, 
his subordinate, or 
his superior report 
on critical features 
of just part of the 
total performance 

(a) From memory 

(b) From immediate 
obsfirvat ion 

(2) Use appropriate 
theory to generate 
behaviors to be 
used 

(3) Use judgments to 
obtain agreement to 
what the model 
should be 

^^ver there is an appvopv 


(1 ) Use appropriate 
theory to generate 
behaviors to be 
used 

(2) Use judgments to 
obtain agreement to 
v/hat the model 
should be 

\ate one available. 



A.2.2 



EXAMPLES 



ACTION 
TO TAKE ' 


"Usina the behavior of 
an expert rs tne r^oaeu 

'Have hvTi verbally 
describe his oi)n 
beliavior 

-Observe a>id describe 
his behavior 


'-Us^ theory to cieTieratex 

a model 
--Use expert judgment 

to create a rodel 
"Deccribe cri.'^ical 

menvs in pprformanre 

of many performers 


'Uenerave jvoTn i^fLt^ui ij u 
statement of terminal 
behavior 

'Secure judgments from 
experts as to what 
terminal behavior 
should be 


CONDITIONS 


Model 
AVAILABLE and 
ACCEPTABLE 


Model 
AVAILABLE but 
l^ACCEPTABLE 


Model 
UNAVAILABLE 


SUBJECT MATTER 
(SCHOOL) 
EXAMPLES 


E.g., have a mathemati- 
cian describe his 
operat ions in 
solving for an 
unknown in an 
equat ion 

E.g. , Have a chemist 
demonstrate how 
he performs an 
exper iment 


-Secure judgments from 
experts as to content 
of terminal behavior; 
and from education 
specialists what form 
behavior should take: 

E.g., geography: how 
the student 
should identi fy 
reiationshi ps 
between raw mate- 
rials' ava i lab i 1- 
ity and growth of 
urban centers 

E.g. , music: how the 
student should 
identify musical 
styles 


E.g., secure judgments 
from educati on 
special ists as to 
the behaviors 
involved in the 
"discovery" 
process 

E.g., secure judgments 
from development 
soecialists as to 
behaviors in- 
volved in 
"cooperat ion" 


JOB 
EXAMPLES 


E.g. , have an expert 
woodworker de- 
scribe al I the 
steps he fol lows 
in preparing 
lumber for use 

E.g. , have an expert 

secretary demon- 
strate how she 
files correspon- 
dence 


-Have many job holders 
or their supervisors 
describe single behav- 
iors that proved 
cri t ical in some por- 
tion of the task of : 

E.g. , trouble shoot i ng 

mal functions in 

electronic 

cQU 1 pm6n L 
E.g., planning manpower 

strategies 


E.g., generate from 

behavior theorV 
a statement of 
teacher behaviors 
to be used in 
manag i ng cl ass- 
room problem 
behavior 

-Use reinforce- 

IIIC Ilk 

strengthen 
adapt i ve 
behav ior 
-Use extinction 
to weaken 
non-adapt i ve 
behavior 
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A.2.2 



MORE SPECIFIC GUIDEMNES WHEN A MODEL 
AVAILABLE BUT UNACCEPTABLE 



IS 



DECISION 
MATRIX 



CONDITIONS 



Model is 
INCOMPLETE or 
NOT SYSTEMATIC 



Model results in 
UNSUCCESSFUL 
OUTCOMES 



Model is 
NOT AGREED TO 



Model is 

COMPLETE and 
SYSTEMATIC 



Model results in 

SUCCESSFUL 
OUTCOME 



Model is 

AGREED TO 



Use theory to develop 
model 



E.g. , teacher lecturing 
behavior may be com- 
pletely described, but 
the model does not lead 
to success; use instruc- 
tional technology model 
to generate nodel of 
lecturing behavior 



Use judgment of 
experts to develop 
model 

E^g. . biologists agree 
contert , but not on 
form of terminal 
behavior : Secure 
judgments of education 
specialists on form 
terminal behavior 
should take 



Develop model by 
describing critical 
elements in performance 



of many performers 

E.g. , troubleshooting 
electronics equipment: 
Performers of this job 
succeed, but the de- 
scription of their 
performance i s i ncom- 
plete; the description 
of their col lect i^c 
experience leoas to a 
complete model 



Develop model by 
describing crit ical 
elements in performance 



of many performers 

E.g. , the major proce- 
dures in the develop- 
ment of curricula are 
agreed to ; the model 
is incomplete, however: 
Secure from many tech- 
nologists descriptions 
of critical elements in 
their performance 



Develop model by 
describing critical 
elements in performance 



of many performers 

Use judgment of 
experts to develop 
model 



Use theory to develop 



pod el 

E.g., counselling pro- 
cedures may be agreed 
on, but they are 
unsuccessful ; use 
theory to generate 
effective model 
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